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PREFACE 


We prepared this book primarily for use in courses in which counselors in 
training (and students in other human services professions) are introduced to 
research methods. Our position is that counselors prepared at the master’s 
level, and even at the undergraduate level, should have a consumer’s under- 
Standing of the more technical types of research methods and actual skill in 
using the less technical types of research methods. With this kind of prepara- 
tion, professional practitioners in the helping fields will be in a position both 
to keep up with the more technical published research and to do practical 
studies of their own in their schools, colleges, agencies, and other settings. 

We also address the book to practicing counselors (and to practitioners 
in other human services fields) in the belief that they will find the methods 
described here and the suggested applications in various settings to be valu- 
able tools in their daily work. f 

For helping practitioners, research ideally will become part of the 
job—not an esoteric activity reserved for the “pure” or highly technical 
researcher but rather the systematic use of what are essentially simple and 
logical ways to answer everyday questions. Obtaining these answers should 
enable us to be more helpful and to demonstrate to our organizations and 
communities that we are offering a responsible and effective service. 

For students planning theses and dissertations, and for specialists in 
research, we hope that these methods will be attractive as alternates or 
Supplements to the traditional quantitative approaches heretofore seen as 
“scientific” methods of study. 
me, | invited chapter authors each of whom is an 
k setting. | chose not to impose a uniform 


outline on them. Instead, each was given a general topic and goals for the 
chapter and was then encouraged to design a structure and approach best 
Suited to that chapter’s topic and that author’s own style. | believe the result 
hapters than would otherwise have resulted. 


is a more interesting variety of cl 
In addition to diversity of styles, these approaches also resulted in a number 
of bonuses when authors included treatments of specific topics | had not 


thought of when planning the book. 
If we are successful in our 804 
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valuable and useful research produced both by people who are essentially 
practitioners and those who are essentially researchers. If that happens, 
research will truly become an underpinning for practice, and the researcher 


and practitioner will see themselves and each other as collaborators in a 
common enterprise. 


LEO GOLDMAN 
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Research Methods 
for Counselors 


INTRODUCTION 


CHAPTER 1 
Introduction and 
Point of View 


Leo Goldman 


This book grew out of conflict and ambivalence. On the one hand, each 
author has been involved in research in the counseling field in different 
roles—as active researcher, instructor of graduate courses, supervisor of 
research workers, and advisor on theses and dissertations. Each, therefore, 
has been in some way identified with “research” as a major function, and all 
have utilized research findings in their counseling work. On the other hand, 
all the authors in this book, to varying extents, agree with the position that 
much or most of the research published in the counseling field has made 
little contribution to practice in the field. 

Each author has made a personal resolution of this internal conflict; the 
individual chapters state and in fact to some extent represent those resolu- 
tions. My own view grew mainly out of my roles asa teacher of counselors 
and an editor of a journal. In the first role | have tried for some twenty-five 
years to teach counselors-in-training at least to understand the importance of 
using published research in their work. Toward this end I tried to help them 
to understand enough about statistics and the methods and principles of 
research so that they could read the literature of the field intelligently. In 
addition I tried to persuade some of them—especially those who went on for 
advanced graduate study or had a special flair for research—that they should 
also be producers of research. I recognized that for most students of counsel- 
ing this was very difficult and very uninteresting subject matter, but I per- 
suaded myself, and tried to persuade them, that it was important and useful. 

Increasingly | came to doubt the value of that instruction and to doubt 
that it really was all that important. Yet my professional-professorial consci- 
ence continued to tell me that it would be a disservice to the field if we let 
people become counselors who did not have at least a good consumer's 


knowledge of research methods and an appreciation of the specific con- 
2) 
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tributions that research has made as a foundation for professional Be 
Further, the conscience said that some counselors—certainly those ae 
doctorates—should be doing their own research and submitting it for publi- 
cation, as their contributions to theory and knowledge in the field. 

From 1969 to 1975 | was editor of the Personnel and Guidance Journal. 
| resolved from the beginning that we would publish only those articles that 
had something to say to counseling practitioners, that we were a reader S, 
not a writer's journal. We found almost no research manuscripts during 
those years that satisfied that criterion; quite a few research reports were 
received, especially in the earlier years, but almost every one of them either 
was so technical that it could not be truly understood except by very 
research-sophisticated people, or was so limited in its implications that it 
really had nothing to offer the practicing counselor. But it remained a con- 
flict situation for most of us involved with producing the journal, a conflict 
that was aroused whenever we received critical comments from readers 
—often highly respected people in the field—indicting us for weakening the 
profession by failing to give research a major place in the all-Association 
journal of the American Personnel and Guidance Association. Over ar 
years, | wrote several editorials trying to explain and justify our position, an 
yet somehow | felt a sense of incomplete resolution of the conflict. 

Finally, for me at least, the pieces began to fall in place in 1975 as a 
result of several experiences that occurred within a period of a year or SO. 
During that year | taught a course in research methods to an unusually able 
class of full-time master’s students in counseling. | used one of the traditional 
textbooks in educational research and, in addition, had the class read each 
week one or two research articles drawn from the current literature of the 
field. In the following semester each of the students was required to plan and 
carry through a research project. In applying the textbook’s standards to the 
articles they read, they found most of the studies either quite flawed in 


design or execution or simply lacking in meaningful implications; of course, 
they resolved that their studies would be better. 


In the same semester in which | 
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not “research” as a general idea but rather the kinds of research that have 
predominated in our field. | became convinced that the kinds of research 
methods and the kinds of research studies that prevail in the field are largely 
inappropriate or inadequate for most of the kinds of knowledge and insight 
counselors require in their daily work. Ironically, | now had a difficult time 
persuading my students to use for their individual projects some of the kinds 


of research that | now felt were the more desirable kinds; they had learned 


the other methods all too well! ; 
This book arose from the experiences of that year and is an effort to 


present to counselors in all specialties and all settings the kinds of research 
that they can do and that would be a real contribution to their own profes- 
sional work, This book does not replace the traditional research textbooks, 
s the position that most of the methods described in those 
ate more for the advanced researcher—the professional 
researcher, the doctorally trained researcher, the researcher who is con- 
cerned more with contributing to the science of counseling, and to theory 
building and theory testing, than to the immediate improvement of practice. 
Therefore, with the exception of Chapter 2, we present here only those 
methods that we believe are feasible and useful for people who are primarily 
Practitioners and who are in the midst of or have completed a master’s 
degree program in the field. Chapter 2 does deal with the traditional re- 
search methods, but from the consumer's point of view. We do not expect 
Practioners to use those methods, but they need to have some awareness of 
them, so that they can at least be critical consumers. 

Some of the authors who have collaborated in this work, myself in- 
cluded, would go even further and would take the position that the less 
rigorous, less technical, more informal methods of research described in this 
book would, in many instances, serve the field better than the traditional 
methods, even for the kinds of basic or scientific study done by doctoral 
Candidates, graduate school professors, and professional researchers. The 
remainder of this chapter explains my Own position on this matter (also 
described in two articles, published in 1976 and 1977), which is essentially 
that the traditional models of research used in our field have overem- 
phasized precision and quantification and the artificial conditions of the 
laboratory, The kinds of problems we are concerned with in counseling will 
be far better served by research methods that study people in their real 
Contemporary worlds and that study them with methods much more qualita- 
tive in nature. Not all the chapter authors agree with DM belief that these 
methods would also be more useful for much ofthe “scientific” research in 
the field, but all agree that these methods are more appropriate for the kinds 
of research that are, or should be, done by practicing counselors. 


but rather take 
books are appropri 
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WHY RESEARCH 
IN COUNSELING? 


Research in the counseling field serves several purposes, or at least it is 
believed to. In a broad sense, as Harmon explains in the next chapter, 
research is one of the three legs supporting the counseling field, the other 
two being theory and practice. Ideally, there is constant interaction among 
the three. The theorist tries to formulate what is at any one time the most 
comprehensive and most advanced explanation of the phenomena we deal 
with—people’s thoughts, feelings, and needs, and the activities that com- 
prise the counselor's work. The theorist builds upon the experiences of 
counselors and the accumulated research and, in effect, provides a blueprint 
for future research by offering new formulations to test. Meanwhile, the 
researcher is also looking toward practice as a source of problems to study 
and as the activity to influence. The practitioner's role in all this is twofold. 
First, it is to let the theorist and researcher know what problems are being 
faced, what lessons are being learned, what insights are being obtained, and 
what methods seem to be producing what results in practice. Second, the 
counselor looks to published research for answers, insights, and suggestions 
that should feed into daily applied activities. At least ideally, that is what 
should happen; in fact, there is little interaction between practitioners and 
the other two and much of the research is not dealing meaningfully Or 
helpfully with the current major concerns of practitioners (Berdie, 1973). It 
follows that counselors do not find much of the published research to be of 
value to them, and in fact do not bother to read much current research. 

In this book we are concerned mostly with applied research that seeks 
to answer practical questions. This is the research that helps evaluate one’s 
programs and practices, the research that helps understand better the people 
and settings one is dealing with. /t is research for action. It is research that 
should, among other things, help persuade the people who employ coun- 
selors that we know what we are doing and are doing something valuable. 
This kind of research is done all too seldom, for reasons discussed later in 
this chapter and elsewhere in the book. For now, it is necessary to state one 
important reason, namely, that counselors have not learned how to do these 
more practical kinds of research and have instead been offered, as a model 
for their own research activities, the much more technical, highly quantita- 
tive methods of the ‘scientific’ researcher. In fact, counselors, even those 
who completed doctoral programs, have been discouraged from doing re 


search because the models they have been offered are so forbidding and of 
so little practical value. 
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THE FAILURE OF 
RESEARCH MODELS 
OF THE PAST 


A number of writers have been reaching similar conclusions in recent years. 
Rausch (1974) has stated the conclusion about professional psychology in 


general: 


So far as one can see, again with the possibility of behavior modification 
methods, research has not influenced practice. (p. 678) 


r or consumer, rejects the traditional model 


The practitioner, whether as produce: 
f no value to him. (p. 679) 


of statistical research because it is O 
We have all been sold a parochial definition of science, and those of us who 
are teachers continue to foist it on students. They buy once—they have to get 
their degrees —but they are rarely return customers. Traditional research proce- 
dures serve only an academic clientele. (p. 679) 

Rausch was referring to professional psychology. Sprinthall (1975) now 
refers to counseling in educational settings: 


What have been the scientific breakthroughs, the great leaps forward? We have 
heard something about learning nonsense syllables (it’s easier to remember the 
first one and the last one), and something about not learning two foreign lan- 
guages simultaneously because of negative transfer and, in reading, something 
about teaching letters first. But the effectiveness of teaching has yet to be estab- 
lished, The effectiveness of counseling and psychotherapy remains problematic. 
After 60 years, where are the guidelines, where is the wall of knowledge, the 
scientific basis for practice? We are only told, “You see, we are still in the basic 
research stage;” or, “In another 15 to 20 years we Il have some valid evidence.” 


(pp. 310-311) 

ong medicine, but their essential validity is 
ws of the research literature on any single 
topic in the counseling field. After careful detailed examination of study after 
Study, and after trying to tease out generalizations, the typical review-of- 
research article concludes that little or nothing can be stated with confi- 
dence and that further research is needed in order to clear up the am- 
biguities of all the preceding research. The problem is that the further re- 


search that is contemplated is of the same types that have failed in the past, 
and the failure in fact results in part from the use of those inappropriate 


methods of research. 


These statements are str 
Confirmed time after time in revle 
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The Failure of the Laboratory 


So many contemporary thinkers are saying, directly or by implication, that 
the venerated laboratory experiment has been highly overrated as a way to 
gain understanding of human behavior as it exists in real life. The traditional 
valuation of the laboratory was inherited from the physical sciences, along 
with the associated values of precision, mathematical formulation, objectiv- 
ity, and isolation from contamination by any but the treatments or interven- 
tions that we are interested in studying. 

A number of observers of the research scene have been concluding that 
the laboratory has become so “pure” that it has little or nothing to say about 
how people function in real life. Gadlin and Ingle (1975) question the “ex- 
ternal” validity of the laboratory experiment; it may be internally valid in the 
sense that, because of all the careful controls, one does indeed know what 
happened during the experiment and perhaps what caused it to happen, but 
the experiment lacks external validity in that we have placed the person in 
such artificial conditions that we have no way to judge whether that person 
would behave in that same manner outside of the sterile laboratory- 


Proshansky (1976) in describing his development as an environmental 
psychologist concludes: 


First, we not only have put aside the laboratory physical-science model for our 
research, but we have abandoned without regret the conception of simple 
cause-and-effect relationships in understanding how the built environment and 
human behavior and experience are related. We worry far less about experimen 
tal controls in doing our research and far more about what, when, and how to 
describe ongoing events, an approach that is possible because we are not look- 
ing for the usual independent-dependent variable relationships. We are looking 
in contrast for patterns of relationships between the observed and described 


properties of physical settings and described reactions of people in these set 
tings. (p. 309) 


Proshansky is saying, in effect, that the relationships among people- 
factors and environment-factors are so complex in reality that it is no loss tO 
give up the laboratory, whose main virtue is that it isolates one factor from 
the other. In this case, the virtue is not a virtue at all but a distortion of 
reality. 

Sometimes, laboratory studies even use simulated counseling methods, 
because the “clients” are not real clients who have sought help but draftees 
or volunteers, often college students, who are asked to participate as sub- 
jects in a study. In such cases, neither the clients nor the counseling methods 


are porains; which decreases even further any possible application of the 
results to real people and real counseling. 
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It has often been stated that the laboratory study is the ultimate in 
scientific method, and that the less precise and less controlled methods of 
field observation are merely preludes to really scientific study. In fact, one 
may wonder whether, in counseling and other human behavioral fields, the 
opposite is the case. The laboratory may permit exploration of variables and 
may suggest things about people and methods, but only real-life studies can 
provide the bases for conclusions and generalizations about people and 


about helping activities. 


The Failure of Purity and Rigor 


Other writers have emphasized the fact that all research knowledge acquisi- 
tion occurs in a cultural framework and within a set of values and beliefs 
about truth and goodness and, indeed, about the role of science in society. 
Therefore, it is self-deluding to think that it is possible to study any 
a pure or culture-free sense (Buss, 1975). 

cientific psychology as a whole, makes the 
al truth and enduring theoretical 


psychological phenomenon in 

Cronbach (1975), viewing $ 
point that it has tried too much for etern 
structures and concludes: 


Too narrow an identification with science, however, has fixed our eyes upon an 
inappropriate goal. The goal of our work, | have argued here, is not to amass 
generalizations atop which a theoretical tower can someday be erected. eat 
The special task of the social scientist in each generation is to pin down the 
contemporary facts. Beyond that, he shares with the humanistic scholar and the 
artist in the effort to gain insight into contemporary relationships, and to realign 
the culture’s view of man with present realities. To know man as he is is no 


mean aspiration. (p. 126) 


Similar ideas have been expressed at more applied levels. In assessing 
Project vatent, a large-scale research progra? that, pone ype things, 
follow dents into their further education and work, McKenzie 

ed groups of stu f little value to continue along those 


(1973) expressed the opinion that it was © 
lines, ni was that more recent populations have grown up In such 
s discovered about the career development of a 


different ti h 

imes that any trut \ jes 

sample from one period in time do not necessarily have validity for a sample 
that has grown up during another era. In a cogent statement he says: 

. . . any creditable study of the future can nO longer rely heavily on sophisticated 

ile categorical responses to questionnaires un- 


statistical treatment of rather ster! l 
accompanied by more probing survey and analytical procedures. (p. 106) 
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He goes on to recommend that future studies reflect the influence on 
people’s career development of such factors as the high unemployment rate 
of one era, the drug-stimulated culture of another, the 12-year involvement 
in Vietnam, the sex revolution, women’s liberation, and other broad societal 
changes. How far this is from the simple administration of questionnaires 
and standardized tests as a mode of research! 

It has been traditional also to value the most rigorous types of research 
design—for example, careful arrangements for subjects not to know what 
the purposes of the study are, lest they be contaminated. Argyris (1968), in a 
careful and detailed analysis, incorporates some of the experiences of 
psychologists in industry on research design. His position is essentially that 
an overly rigorous experimenter can have undesirable effects on research 
subjects, much as an overly rigorous supervisor can have undesirable effects 
on workers. Among the effects in both instances are dependency, overt and 
covert withdrawal, aggression, and eventual banding together—against the 
researcher in the one case and the supervisor in the other—in order to 
protect their own interests. Under such conditions, the researcher cannot be 
certain that the subjects are responding or behaving genuinely, and the 
results of the research may therefore be seriously distorted. 

Before leaving the topic of rigor, we should heed Levine’s (1974) cau- 
tion that rigor does not necessarily inhere only to laboratory and quantitative 
kinds of research. We will later in this chapter examine some of his ideas, 
the essence of which is that the intelligent human mind is as effective a 
ne tool as the pseudoprecise instruments customary in “rigorous” 
research. 


We may well conclude this section with a cogent statement by Rausch 
(1974): 


I would suggest that we scuttle a narrow, parochial, outdated definition of 


research— one that would eliminate major contributors ranging from Darwin tO 


Freud to Piaget— in favor of definitions appropriate to natural and social sci- 
ences and the humanities. (p. 679) 


NEW DIRECTIONS 
FOR RESEARCH 


This book is directed mainl 
who have contributed to i 
doing research of a less tr 
posed, and the methods a 
intended mainly for that 


y to counseling practitioners, and all the authors 
t are in agreement that practitioners should be 
aditional nature. The principles now to be pro- 
nd practices described throughout the book, are 
audience. But most of the chapter authors, and 
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certainly most of the writers cited and quoted in this chapter, are also in 
agreement that the traditional methods of research have not been especially 
productive even for the pure or basic researcher, and that both basic and 
applied research would benefit from a change to methods that place less 
emphasis on precision, objectiveness, quantitative methods, and the isola- 
tion of the laboratory. The following pages are addressed to both kinds of 


researcher. 


Study Current Problems 


Research in counseling is so much more useful and alive when it deals with 
current problems and current situations. Too much research—in psychology 
as a whole as well as in counseling—has sought to establish basic laws of 
human function for all time. As Cronbach (1975) was earlier quoted as 
saying, it is enough of a challenge to understand how people function during 
any one period. One way to do that is to begin our quest for research topics 
in the more advanced centers of professional activity—in those schools, 
colleges, and agencies whose counselors are in the vanguard of professional 
functioning and are trying out new ideas and new methods. In this book, we 
have done just that; we have, for the most part, focused on the newer 
conceptualizations of counselor role in these various settings. If we all do 
that, we will be less likely in the future to repeat the situation that Berdie 


(1973) bemoaned as a journal editor: 


During the past several years, the Journal of Counseling Psychology has re- 
ceived few or no papers that have described or evaluated counsel ing programs 
for alcoholics. No papers have described a systematic theory of the develop- 
ment and structure of measured vocational interests. Few papers have described 
or evaluated team or multiple counseling treatment. Counseling of runaways 


has been given no attention. (p. 393) 
8 


rnal of Counseling Psychology is probably typical 
of most research journals, and it is not therefore surprising to hear prac- 
titioners say that they do not bother reading those journals. 

To correct a situation, one should have some idea of its causes. Here 
We can only speculate. It may be that most published research is done by 
People who themselves are not practitioners In the newer modes. One can 
speculate that the people who are in the forefront of new modes of practice 
are often found in service departments and institutions where research and 
Publication are not as highly valued as they are in academic departments of 
Colleges and universities. One can speculate that the kinds of people who 


The experience of the Jou 
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initiate and implement new ideas in practice tend not to be inclined to write 
but more often to thrive in the action scene. One can speculate that, for the 
most part, it is easier and more comfortable to do research in traditional, 
relatively unchanging settings and on traditional and relatively unchanging 
topics. Among all these speculations there probably are some grains of truth. 

Later in this chapter, we consider the question of how to spur more 
research activity in the action scenes. For now, we only suggest that those 
who do research, and journals that publish research, should place much 
higher value on studies of the current scene, even if that means some sac- 
rifice in precision and rigor, and certainly if it means more discomfort be- 
cause of the not-fully-crystallized and constantly changing nature of the 
leading edges of our field. Certainly, journal editors and manuscript review- 
ers should apply to each proposed article the criterion: how much does this 
add to our knowledge of what is happening in the counseling world today? 


Study in the Field 


Previous sections have assessed the inadequacies of the laboratory and the 
controlled experiment as means of understanding how people function and 
react in real life. ““Unobtrusive” or “nonreactive” research (Webb, Camp- 
bell, Schwartz, and Sechrest, 1966) certainly raises many problems of ethics 
and research design and technique. These are the methods that observe 
what is happening rather than ask people questions or perform experiments. 
Social psychologists have used such methods quite a bit to learn, for exam- 
ple, how people behave in crowds, without letting them become aware that 
they are being watched. To observe and study people as they function in 
classrooms, in families, on the job, and in counseling activities—to do this 
unobtrusively and to see how people act rather than how they react to 
questions or interventions—calls for the utmost in care and tact, Indeed, the 
results of such study often do not give one the feeling of comfort that every- 
thing has been neatly controlled or accounted for. The conditions of field 
study are often messier than those of the laboratory, not necessarily more 
difficult, but messier. Our conclusion, however, in weighing the advantages 
and disadvantages of the two approaches, is that the rougher field conditions 
will offer more insights and will permit much greater generalization of the 
findings to the real world in which our counselees and consultees live, learn, 
work, play, and receive help from counselors. 

‚One of the most important values of field-based research is that it 
provides an unusually rich Opportunity to engage in a continuing process ol 


relating theory, research, and practice. Sprinthall (1975) describes it in the 
following manner: 
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Natural-setting research implies a constant interplay between investigation and 
analysis of significant questions. The action/reflection sequence (try out, ex- 
amine, then try out again) should replace the classical hypothesis-testing basis 
for research. The feedback cycle will provide the means to analyze and correct 


any error before the next step. (pp. 314-3 15) 


The chapters in Part 3 spell out many specific approaches that may be 
used in field-based research—studies of individuals responding to environ- 
mental changes, participant-observer studies, longitudinal studies, and 
evaluations of programs and projects. Then, in Part 4, the authors suggest 
many kinds of field studies for specific settings—school, college, rehabilita- 
tion, vocational and employment agency, and community counseling. 
Readers, whether practitioner-researchers or specialists in research, will 
find in both sections a wealth of useful ideas for field-based studies. Practic- 
ing counselors would do well to take advantage of these rich opportunities. 
Specialists in research are advised to seek active collaboration with prac- 
titioners in field settings so that together they can foster the kinds of interac- 
tion that have thus far been more of an ideal than a reality. 


Study Individuals Rather than Groups 


Traditionally, research in counseling deals with numbers of people and their 
tentral samelcriches (means, Medians are Memes and telr variation (stan: 
dard deviations and ranges). Most published studies describe the average or 
typical ability level of students in a school or college, or of workers in an 
occupation, or of some other group. Many studies report the correlation for a 
group of people between two measures, say of interest on the one hand and 
satisfaction in some field on the other, and ask the question, in general, do 
the people who have more interest in an area tend to be happier in it? Some 
studies describe the use of a counseling technique with a number of people 
and report how many respond positively to it, or how the people who 
respond more positively tend to rank on other measures. Chapter 2 explains 
these kinds of studies, and Chapter i ae gives many examples 
drawn ‘onal counseling literature. 

ja p hrai studies, and many others, the results are almost 
Never about individuals but about types of people, or BIOUPe of people, or 
People who have something in common. True enough, if BUS ln 
selecting students or employees, such studies can provide usable informa- 


tion and can often spell out how many poor choices can be avoided and 
how many dollars saved by reducing turnover if certain selection devices or 
methods are used. If enough people are involved, even a test or an interview 
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or other selection technique that correlates quite low with success in pi er 
or on a job may increase the efficiency of selection by avoiding the er 
sion or hiring of people who would probably have failed. Every such mista : 
avoided is that many dollars saved in training, supervision, counseling, ae 
the paper work to hire and fire, not to speak of the personal a : 
those involved. Any selection procedure, of course, also inevitably ma = 
mistakes—either by selecting people who later turn out to be failures, or y 
rejecting people who would have been successful. But we are thinking Ta 
only of the interest of the school or company doing the selecting. From E 
selector’s point of view, the saving of money and time may justify th 

procedure; relatively simple studies provide the data for that judgment. 

However, the usefulness of most of these studies for individuals has 
been greatly overstated. Correlation coefficients in the .40’s, 50's, oraven 
.60's that are regarded as ‘‘moderate”’ or “good” for group predictions sa 
for the most part, of little or no value if we are trying to make statement 
about individuals (Goldman, 1973). Even with a correlation of 60, say 
between a college aptitude test and grades in one specific college, sne 
about as high as one ever finds, the statement as to the probable gra ‘ 
average that any one student with a given test score is likely to attain has y 
be given within such a wide range as to be ridiculous. (As an illustratio i 
with a correlation of .60, a student who receives a score at the 84th percen- 
tile on the aptitude test would have two chances in three of standing ge 
where between the 42nd and 92nd percentiles in college grade average. i 
we wanted to extend the band so that it included the nine in ten chances et 
probability, the range would be so wide as to become truly ludicrous.) Mos 
correlations for success or satisfaction on specific occupations or jobs ars 
well below .60, so the usefulness for any one individual, though it may Þe 
“statistically significant,” is for practical purposes close to nil. 

Rarely are studies designed in such a way as to permit one to coneluon 
how any one person, with his or her makeup of abilities, interests, ie 
temperamental characteristics, is likely to function in a school, college, JOP, 
or indeed in a counseling experience. To take an example that has pean 
much studied over many years, “underachievement” has been found typ! 
cally to be correlated moderately with each of a number of different factors, 
such as too much socializing, not enough academic interest, excessive anxi- 
ety, poor study habits, and others. Journals continue to publish studies that 
show such simple Correlations, with some variation from study to study 
depending on what Population was sampled and what aspects of the stu- 
dents are studied, Multiple correlations are only slightly better. Though they 
show the combined predictive power of two or more tests, school grades, 
and other factors, they still tell only how people with those total scores did in 
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school or on the job, not about the achievement of individuals and why 
those individuals achieved as they did. Almost never does anyone study 
constellations of factors as they operate within individuals. How one longs 
sometimes for a few case studies to give life to the phenomenon being 
examined and to give one a basis for understanding better the occurrence of 
underachievement in any one student. 

To understand individuals, and to be able to apply those understand- 
ings in helping efforts with individuals, it is necessary to study individuals. 
Several research designs for that purpose are described in Parts 3 and 4. 
They include systematic observation of what happens to individuals as re- 
wards or other interventions are applied; case studies; and long-term 
follow-up of individuals. These methods not only have the advantage of 
permitting applications to specific individuals, but they also involve a 
minimum of statistical work and therefore bring the research methods within 
the reach of working master’s level counselors. (For me, the absence of 
esoteric and complex statistical methods has an additional virtue: some- 
times researchers become so absorbed in the statistics and the search for 
“significance” through statistical tests that they lose sight of the data them- 
selves and their actual meaning and value. To put it another way, high- 
Powered statistics sometimes camouflage low-powered data.) 

The systematic and even quantified study of individuals as they re- 
spond to environmental changes has been highly refined in recent years and 
has become quite widely used, especially with behavioral methods of inter- 
vention. (See Chapter 4 for details). More neglected and much in need of 
revival as a respectable form of resea rch is the case study or case history. No 
doubt precautions must be taken to avoid bias in selection, presentation, 
and interpretation of case study material; with such precautions, the case 
study has much to offer. As Rausch (1974) points out, such clinical studies 
Need not be restricted to individuals but can focus on families, groups, 
institutions, plays, novels, or films. Rausch describes them as case histories 
that focus systematically on psychological themes or theories. They certainly 
deserve a major place among the research models used in the counseling 


field, 


Study the Whole Individual 

almost any field to begin by studying 
nd then to break the discipline into 
e from macroscopic to microscopic 
elopment has probably been fruitful 
|| have been counter-productive in 


It probably is typical for research in 
arge-scale segments or phenomena a 
Smaller and smaller segments—a MOV 
levels of examination. This kind of dev 
IN the physical sciences, but it may we 
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the social sciences and the humanities. The common saw nn 
students learn more and more about less and less until ed n : i en 
deal about almost nothing” is a reflection of the belief on “ pa an 
that this kind of development is not entirely in the interest of huma 
may sometimes make people less effective rather than ania ee 
The rationale, of course, is that as a field grows in complexi en 
person can know only smaller and smaller portions of it and “hag nb a 
sary to isolate smaller and smaller segments in research. The pr hen 
applying this principle to human behavior is that the ne = 
thoughts, feelings, perceptions, values, and experiences is so vita a uns 
sometimes finds microscopic studies of any one of these to be o a 
meaning. Buss (1975), Proshansky (1976), and McKenzie (1973) ik of 
viously cited on the point that, when studying any one reaction or cee aa 
a person, it is important that the reaction or attitude be studied on Doel 
light of the pertinent things about the person’s (and the researcher's) tote 
being and environment at that time. . en 
Aside from the fact that microscopic-size studies often are nn: in 
meaning, they defy interpretation. To know that counselees reacted % 
such-and-such a manner to counselor questions or reflections has 
meaning if we do not know how those counselees perceived the counse 4 
and the situation at that moment, and what else of pertinence was napper 
ing in their lives at that time. Indeed, if it was a pseudo-counseling eh 
as so often is the case in published research, or a simulation through ye 
eotape or other medium, one can only wonder how the enpnselees 
viewed what was happening and whether their reactions bore any oar 
blance to what they were doing in real life. [See the earlier reference i 
Argyris’s (1968) analysis of the unintended consequences of rigor | 
research. ] a 
Certainly it is not possible for every study to include every pertinen, 
aspect of each subject's life. However, it is important that most studies 5 
least try to find out what the su bjects’ perceptions were of what was happe ir 
ing during the study and to ask them to assess the generalizability ol rd 
behavior during the study. This raises the question of the subject's role int 
entire research enterprise; that calls for some discussion as a separate topIC- 


Involve the “Subject” as Collaborator 


Many have objected to the word ” 
and because it su 


Argyris (1968) 


r Ps izin 
subject” because it is so dehumaniz! T 
ggests such a passive, manipulated person. In fact, Te 
points out, this status may backfire on the researcher; peoP 
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who are being questioned or manipulated for purposes they do not under- 
stand may defend themselves by withholding or distorting their responses. 
One of his suggestions is in fact to inform the participants, insofar as possi- 
ble, as to the purposes of the study and to develop in them some feeling that 
they are active participants in a search rather than passive reactors to an 
ambiguous searcher. Gadlin and Ingle (1975) suggest that we borrow a leaf 
from anthropology and regard our “subjects” as “informants” rather than as 
uninformed objects. ; 

One of the presumed advantages of this recasting of the place of the 
subject in counseling research would be a mitigation of the ethical concern 
that one must always bear in mind—the concern that the subjects are doing 
things they would rather not do if they were fully aware of what is happen- 
ing, or are revealing things they would not consciously reveal, or actually 
suffer some undue effects from the study. True, informing the person of 
everything about the study could contaminate the results, and certainly one 
is justified in withholding some things, at least until after the subject's par- 
ticipati F mpleted. 

a en one would probably be well advised in most 
cases to err in the direction of sharing too much rather than too little. In 
addition to the reasons already stated, there are two more. One is that the 
researcher may unwittingly be influencing the results of the study by giving 
Cues or misreading observations (Rosenthal, 1966). Another reason is the 
tendency that we all carry to some extent—the belief that because one’s 
research is in the interest of increased knowledge or improved professional 
Practice it is all right to manipulate and even deceive people somewhat; 
after all, the experimenter knows that it is all for a worthy cause. However, 
the American Psychological Association (1973) found it necessary to de- 
velop a separate set of ethical principles for research, for the very reason that 
No person, even the most competent and conscientious, can be trusted todo 
the ethical thing at all times and to protect fully the privacy and rights of the 


individual being studied. 

In many ways, what is p 
enter into a kind of contractua 
the counselor as helper enters into 
than just “doing things” to people. 


roposed here is that the counselor as researcher 
| relationship with research subjects, much as 
a kind of contractual relationship rather 
True, we stand to lose some freedom of 


Professional movement in both instances, but in the total scene there will 
Probably be more honesty all around and therefore a net nz in the 
value of the research, just as most counselors these days believe that their 
helping activities are more valuable when counselees collaborate with full 
awareness of what is happening and full commitment to the process. 
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Make Place for the Subjective and Qualitative 


As we have seen over and over, the counseling field, like all of psychology 
and probably the social sciences as a whole, has become increasingly = 
cerned (1 would say “obsessed”) with precision, quantification, an 

microscopic-level examination of people and of the counseling process. The 
time has come for a return to respectability of the less formal, more subjec- 
tive, even looser methods that seem to be acceptable in the early days ota 
discipline, the days when creativity and imagination are valued. The intel- 
ligent mind and perceptive eyes and ears of the researcher should again 


have a position not only of acceptability but of prominence. As Levine 
(1974) states: 


It is my feeling that disciplined human judgment can do at least as effective a job 
in many tasks as a reliance on pseudoprecise instruments and imperfect designs. 


... the basic research instrument is the human intelligence trying to make sense 
out of what it observes... , (p. 674) 


Levine goes on to spell out a leg 


al kind of model, where one person acts as 
an adversary 


and someone else as a witness, to monitor any bias or error that 


may result from such subjective processes. This model is discussed in Chap- 
ter 7. 


In an editorial written durin 
American Psychological Associati 
been a leading writer for 
search, considered the in 
concluded that: 


g his term of office as president of the 
on, Donald Campbell (1976), who had 
years on rigorous, quantitative methods of re- 
adequate state of research in psychotherapy and 


We need to reactivate earlier and less pretentious models, 
produced valuable research. Much of this rese 
nature. Such qualitative study is an essential un 
ence. (p. 2) 


which in their day 
arch will be “qualitative” in 
derpinning of quantitative sci- 


Campbell made specific suggestions. One is that each psychotherapist (for 
which we can read “counselor’’) offer a free visit one year after termination, 
during which there would be an updating of the patient's (“client's”) life 
situation and an attempt together to evaluate the effects of the treatment. 
Campbell also suggests reviving the practice of systematic note-taking and 
record-keeping after each session, to be accompanied by the patient's own 
record and view of what was happening. 

Another example of a more subjective and qualitative method is the 
use of the interview as contrasted with the questionnaire as research tools- 
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For most purposes, | would rather have 25 or 50 well-done interviews than 
1000 questionnaires. There is a greater likelihood of approaching 100 per- 
cent response from the people whom one asks to participate in an interview 
study than those to whom one sends a questionnaire. Even more important, 
there usually is no way of knowing why the nonrespondents to a question- 
Naire (who typically comprise 20 percent to 50 percent of a sample) did not 
respond. Further, the data from a questionnaire have the serious disadvan- 
tage of not indicating how any given respondent perceived the question- 
naire as a whole or any specific item on it. As a result, no matter how 
fastidiously the questionnaire was constructed and tried out, responses to it 
remain essentially ambiguous and equivocal in their interpretation. Of 
Course, this has not stopped researchers from reporting questionnaire data as 
if they were facts or at least precise measures, and diligently calculating 
Means and standard deviations to two or more decimal points, thus giving 
them an air of the precision they do not have. (To claim that in a large 
enough sample individual differences in perception and interpretation of 
items will balance each other out is hardly reasonable. Ambiguity multiplied 
by any number remains ambiguity.) . 

_ The interview, by contrast, when well done, permits follow-up ques- 
tions to clarify a response and allows much greater depth than a question- 
naire. One must, of course, take measures to minimize the risks of inaccu- 
rate recording and misinterpretation of responses. With the advent of the 
Cassette recorder, it is easy enough to record every interview so that at least a 
sample of them can be checked by an independent judge for accuracy of 
recording and interpretation. In those cases where people refuse permission 
Or are reluctant to record, at least each interviewer can be carefully trained 
and a sample of practice interviews checked for accuracy. 

We are ina field that deals with nonprecise phenomena, with intangi- 
ble qualities, and with constantly changing people and situations. It is there- 
fore highly appropriate that our major research methods include the subjec- 
tive and the qualitative and the relatively unfettered approaches. To capture 
the reality of a human life or an encounter is more an artistic than a scientific 
accomplishment—at least if we define science as it is usually defined in the 
Physical sciences. Ours is not an exact science or an exact practice. It is 
therefore illusory to expect that our research will be exact. 

This is not to suggest that no cautions are needed and that one may use 
ANY subjective approaches in any way one wishes without impedence. All 
research methods require a careful statement of the specific purposes and 

€ expected outcomes of the study. Whether interviews or questionnaires 
are used, questions must be phrased carefully to avoid ambiguity or confu- 
Sion, Even more critical, measures must be included in the study to detect 
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and reduce to a minimum the possibilities of bias in the interpretation of 
responses. Fortunately, there are well-established methods for Bee 
these and other flaws in a study—preliminary tryouts of questionnaires an 
inventories, independent interpretation of a sample of responses to check 
the researcher’s own interpretations, careful training of interviewers, and 
others. More sophisticated methods may be warranted in some studies; 
Levine’s (1974) legal model, already mentioned in this chapter, is one ex- 
ample. 5 
And of course each research method has its limits. For instance, if 
appropriate sampling and statistical methods have not been used, then one 
cannot generalize beyond the people studied. However, for the vast major- 
ity of studies that practitioners can and should do for their own information 
and for the improvement of their work, sampling and statistical inference 
may be of little or no concern. This point is emphasized over and over in this 
book, but especially in Chapter 6 where the distinction is made between 
applied evaluation and theoretical research. . 
By using appropriate checks and not overstating the conclusions ot 
their studies, researchers may use these more subjective and qualitative 


methods for a large portion of the problems that concern us as practitioners 
and scientists. 


Planning for Research Implementation 


Too often research has stopped with the writing of 
with the expectation that it would now be read 
The more usual experience is th 


a report or an article, as I! 
and used by many people: 
at few, except other researchers, ever rea 
research reports. To some extent, this is because so few research reports 
have any immediate application in practice. 

But it is unrealistic to expect that almost any research reports, even 
those that do have immediate implications for practice, will be read and 
used. For one thing, counselors are inundated with journals and books and 
special reports. Even with the aid of systematic methods, such as those 
described in Appendix B, for locating published and unpublished studies 
—the ERIC system, abstracts of various kinds, locater services, and so on—it 
is still an overwhelming scene that confronts the conscientious counselor 
who would like to keep up with research. 

The first task then is to bring to counselors’ attention the facts and ideas 
that have been uncovered in one’s study. The second task is to get them tO 
Consider the meaning and implications of these facts and ideas. And the 
third task is to get them to do something with what they have learned, 
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assuming that the iiai imply change of some kind. As Glaser (1973) 
says, “Ideas alone will not generate and sustain change” (p. 437). 

The situation is similar in some ways to counseling; the counselor now 
is in the position of the client who needs information, who needs help in 
interpreting and weighing and accepting the information and in deciding 
then what to do about it, by way of action. 

If research is to influence practice, something akin to a counseling 
Process is needed. The information must be seen or heard, and it must be 
understood and its legitimate implications accepted. The usual technical 
research report is pretty forbidding to start with and often includes little or 
nothing by way of implications for practitioners. (The journals themselves 
are not entirely to blame; journal editors quite generally find that they must 
push authors pretty hard, and repea tedly, to get them to stick out their necks 
into the realm of counseling practice and discuss specitic implications and 
applications of their research findings.) 

We must therefore seek new styles and modes for reporting research 
findings. For some people, the printed word or a paper read at a conference 
are excellent means of communication, but these days most people have 


become accustomed to more interesting and engaging methods such as 
films, television, slide-and-cassette, and the hands-on and interactive fea- 
tures of workshop experiences. A full program of such dynamic dissemina- 
tion should be a part of each research plan; to be certain that this will 
happen, it is wise to include a plan for meaningful dissemination as part of 
the total research project before beginning the study itself (Glaser, 1973). 
As Glaser cautions us, even a well-rounded meaningful program for 
dissemination is not enough. There needs to be a continuing interaction with 
the potential users of the research, to help them to deal with the many 
internal and external barriers to change, and to give them continuing sup- 
Þort and help in the process of decision and change. Here we can bring to 
ave learned from the experience of counsel ing, consultation, 
and organizational development. In each of these areas, there is a consider- 
able body of wisdom about the ways in which change occurs. reinn 
are resistant enough to change under the best conditions; many counse x 
Work in institutions where the conditions for change are much less than the 
best, so the task is a formidable one indeed. 
Perhaps we need a new kind of intermediary between research and 
Practice, a linking agent (Glaser, 1973) who will help bring together in 
Continuing ways the producers and the consumers of research. Someone 
who will play this role is almost certainly needed in connection with pub- 
ished research that is to be used in many different settings. But a linking 
agent may be needed even when the research is in-house, even when it was 
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done by counselors on the staff of the organization. The understandings and 
skills needed by such a person probably are very close to those needed todo 
consultation and even counseling itself. 

Many ideas regarding the dissemination of research findings are found 
in later chapters. In particular, Chapter 3 examines in considerable detail all 
aspects of communicating research to its consumers, and Chapter 10 de 
scribes some exemplary programs in the rehabilitation field. 


HELPING COUNSELORS 
DO RESEARCH 


Most people who select careers as counselors tend to be uncomfortable with 
courses that involve statistics, such as measurement and research methods. 
Further, counselors tend to be people-oriented and action-oriented and by 
temperament usually find the activities that go into research work not esPe 
cially congenial. All of this constitutes a very real barrier between coun 
selors and research activities. 

Another barrier arises from the kinds of research models that have been 
presented to counselors in their courses, textbooks, and journals. Studies 
that are regarded as good quality, in addition to being few and far between, 
tend to involve rather forbidding techniques and procedures. Certainly for 
many practice-oriented people the experience of doing a good dissertation 
under rigorous professorial supervision is enough to discourage them from 
ever trying it again, especially on their own. 

Finally, counselors tend to work in busy service arms of schools, col- 
leges, and agencies where there is little time, money, or assistance for fe 
search activities. Conscientious counselors may actually find discourage” 
ment of their efforts to do research, even if they request no time, money, or 
assistance. Research is not high in the hierarchy of values in most of thes® 
settings (though again it must be said that the failure of most research in the 
past to make any discernible contribution to practice is a very real factor): 

In effect, this book is an attempt to at least whittle away at the first two 
barriers. The kinds of studies we emphasize call for a minimum of statistica 
competence, in many instances none at all. We stress qualitative researc” 
and practical studies that should be within the reach of most practitioners: 
For the most part, we focus on local studies that may or may not be Of 
interest to other institutions. In many cases they would not be suitable for 
publication because they have only local significance. This should in NO 
way be viewed as a downgrading of such studies; in fact, local studie® 
probably have far more to offer counselors than “national” studies, both in 
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terms of the useful information they provide to the counselors, and in terms 
of supplying evidence of the value of the counseling program. 

So, we are inviting readers to join us in an exploration of truly task- 
oriented, meaningful studies where research means a search for understand- 
ing and good ideas. We are not concerned with the publish-or-perish moti- 
vation to do research. Not that we expect to see much change in that 
tradition which, unfortunately, has produced so many journals full of trivial, 
unimaginative, and largely useless research reports (though some journals 
have recently broadened their conception of appropriate articles) but that is 
not where we are or, we hope, our readers. Instead, we believe that the vast 
8ap between practitioners and researchers can be closed, at least partly, if 
practitioners become researchers and if researchers offer practitioners the 
kinds of research that will have real meaning on the firing line. 
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THE COUNSELOR AS CONSUMER OF 
RESEARCH 


CHAPTER 2 
The Counselor as 
Consumer of Research 


Lenore W. Harmon 


Most counselors working in educational settings and social agencies are 
busy people. The more innovative and successful they are at their work the 
busier they are. They are concerned with helping as many people as possi- 
ble and there are always more people to help (Schofield, 1964; Greenberg, 
1965). Busy as they are, counselors would want to keep up with research in 
the field if they thought this would make them better helpers, but most have 
felt that research is not as helpful in their work as they would like it to be. 
Many research results are indeed too narrow or too equivocal to tell the 
Practitioner much about how to improve counseling practice. However, | 
believe that the practicing counselor should be a consumer as well as a 
Producer of research. The first portion of this chapter is devoted to a discus- 
Sion of that position. Later portions of the chapter investigate how the coun- 
Selor can become a consumer of research, and the remainder of the book 
Indicates some practical ways and areas in which practicing counselors can 


become producers of research. 


WHY READ 
RESEARCH? 
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shooting beer cans off a fence. Counseling is much more important than 
shooting beer cans off a fence. Thus, it is important that we not neglect a 
potentially useful tool—research—just because it has not yet been very 
useful. 

Counselors should be consumers of research for several reasons: (1) 
there are potential effects on their own professional development and effec- 
tiveness with clients; (2) their own research will be influenced by their 
knowledge or lack of knowledge regarding previous research; (3) only the 
counselor can really take responsibility for the quality of service offered to 
clients. Each of these reasons, as well as the relationships among theory, 
practice, and research, is discussed further. 


Reading Research Contributes to Professional Development 


As in all fields, ideas in psychology have increased exponentially in recent 
years. The practicing counselor must be aware of new developments but at 
the same time be critical and selective in applying them. Many of the 
“theories” that have been proposed for application to counseling are little 
more than collections of ideas with meager evidence to support either the 
relationships claimed in the theory or the effectiveness of the theory a5 
applied to counseling. There is a period in the development of new theories 
and techniques when this situation is natural—however, it should be tem- 
porary. Client-centered theory and therapy provide a good example of how 
a theory developed and was subjected to empirical test. Rogers (1959) tells 
of his early search for ways to test his ideas; subsequent major researc 
projects resulted from his determination to do so (Rogers and Dymone, 
1954; Rogers, Gendlin, Kiesler, and Truax, 1967). Applications of learning 
theory to counseling have also been demonstrated through research (8-8. 
Lazovik and Lang, 1960; Krasner and Ullmann, 1965; Mann and Rosentha 
1969; Spiegler, Cooley, Marshall, Prince, Puckett, and Skenazy, 1970): 
However, many so-called “theories” have existed for too long as untest 
ideas, to the extent that they approach the status of fads. Without an aware 
ness of current research the practicing counselor is a prey to faddism 1 
Psychology. There is evidence, for instance, that Perls (1969) was concern® 
that gestalt therapy was being accepted at the level of a fad by practitione"® 
who made little attempt to understand its theoretical basis. Reading researc" 
Jie A counselors to identify well-researched new theories an 

ir Mee their own practice. mes 
research, this is not strictl “a ‘ana implies that The :counpelop can 

, y so. To “consume” is “to destroy or expen 
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use” (Stein, 1967). Actually, the counselor does not destroy or expend re- 
search by using it, but the service offered, counseling, is destroyed or ex- 
pended by use. No counseling hour or minute can be relived. To the extent 
that time spent with a client is less effective than it could be, the efforts of the 
counselor and client are wasted. Knowledge of research can help the coun- 
selor be more effective in the limited time available for each client. Coun- 
selors who spend some of their time trying to find ways to make their 
services more effective—by reading research and by attending conferences 
and workshops—are more likely to be effective. 


practicum student that clients who dis- 
defect from counseling. This infor- 
ht of a practicing psychologist. As | 


AN EXAMPLE. | was taught as a 
Close too much in early interviews often 


Mation was presented as the clinical insig 
gained experience as a practitioner, | observed the same thing. My approach 


to the problem was to attempt to control the amount of client disclosures in 
early interviews although | felt uncomfortable about doing it because of a 
Competing belief that clients needed to disclose their problems as freely as 
Possible for maximum growth. The work of Heilbrun (1973) suggested a 
Solution to my dilemma. He was interested in female defectors from therapy 
and had previously hypothesized that dependent females drop out of 
therapy as a response to frustration with the nondirective behavior of male 
therapists, The new hypothesis he explored in his 1973 work was that 
females disposed to leave therapy early have a history of difficulty in self- 
disclosure especially with men. His results showed just the opposite. 
Females who were disposed to leave therapy early had a history of greater 
self-disclosure and greater self-disclosure to the men than women not dis- 
Posed to leave therapy. He concluded that women who have disclosed 
More to males and fathers in particular would be especially frustrated by 
Nondirective male counselors. He did acknowledge that these defectors 
on therapy might not be frustrated but instead gratified that someone had 
'stened, and he suggested fu rther research along that line. His research was 
extremely specific, and its major findings were about female clients and 
Male counselors but | did find it very useful. | generalized from these 
indings to male and female clients and to male and female therapists. l 
changed my counseling emphasis from one of preventing extreme self- 
'sclosure in early interviews to one of providing more structure about what 
Might happen next in counseling during early interviews where a great deal 
Of self-disclosure took place. I did this more by summarizing and highlight- 
a iets for my client than by controlling the course of therapy com- 

etely, 


It could be argued that | have generalized too much from Heilbrun’s 
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findings and that the issues involved have not been ar hee = 
agree. However, my current practice is based on better a ka 
ous practice was, and | am aware that more data are likely to be for 
Heilbrun and his associates. . 
ee | could check out my application of Heilbrun’s findings if | nn 
large counseling center devoted to research. This could be done by a se 
tering the Adjective Check List, which he used, to each client ae ieee 
seling began and scoring it on the Readiness for Counseling Scale pot 
mine the client's propensity to terminate counseling prematurely. je 
would be randomly assigned to male and female counselors who ha os 
trained to offer two different conditions in the initial interview. One A ve 
tion would be an extremely nondirective approach and the other woul J a 
more structured and directive approach. If women with low an 
counseling left nondirective counseling with male counselors more nn 
than women with high readiness for counsel ing, Heilbrun’s idea that wo ad 
are frustrated by nondirective counseling from male counselors woul ae 
supported. If women with low readiness for counseling left nondirec ‘of 
counseling with either male or female counselors more often than they 
more structured and directive counseling with either male or female ne 
selors, my application of Heilbrun’s work would be supported. That a 
defection from counseling would be more highly related to the counse te 
conditions offered than to the sex of the counselor. Using male clinon a 
well as women would afford an opportunity to contrast the effects of 7 
treatments across sexes. | could also follow up those who dropped out 1 
counseling to determine their frustration level in order to explore io 
suggestion that the perceptions of defectors from therapy should be 
plored, a 
My findings would have implications for further research, an 


: . À ; Ive 
whether or not certain types of clients continue in therapy and reso 
problems that concern them. 


Reading Research Stimulates Better Research 


The underlying thesis of thi 
should do research that ta 
doing this are described 
proved by a knowledge 
studies. The more a resea 
search in an area, the be 


5 book is that practicing counselors can ani 
kes place in the field settings they work in. va 
in subsequent chapters. Such research can be | 
of more theoretically and experimentally bas = 
rcher knows and understands about previous ' 
tter study the researcher can plan. 
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; The worst enemy of good research is poor planning. It is frustrating to 
finish a study, as | have done, and find that one additional important 
hypothesis could have been tested easily, if I had taken the time to read the 
literature more exhaustively so that I saw how important that hypothesis 
was. A great deal of energy is wasted on research that does not accomplish 
what the researcher intends it to accomplish because research ideas and 
plans are put into action prematurely without adequate consideration of 
both theoretical and methodological concerns. Reading research consis- 


tently helps to overcome these problems. 


Relationships Among Theory, Practice, and Research 


Figure 2.1 suggests the ideal relationship between theory, research, and 
Practice, The arrows go in both directions between each dyad, indicating 
that knowledge flows both ways in this system. The three components are 
arranged in circular fashion indicating that no component is “the” begin- 
ning. Knowledge can begin in any of the three areas and move in any 
direction. For instance, an idea can develop in the realm of practice, be 
tested in a research study, and ultimately add to or modify a theory. — 
My suggested extension of Heilbrun’s work exemplifies this—the idea 
began with research and was extended to practice, which could result in 


further research and ultimately extension of a theory. 


IN 


e—a 


Research 


FIGURE 2.1 Relationships AMons Theory, Re- 


search, and Practice. 
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i < is the 

AN EXAMPLE: HOLLAND’S THEORY. Areal pore oe ae pe 
development of John Holland's theory of careers. d "1959 1966) in part to 
this theory he attributes its first formulation (Holland, der afiihe vocdtianal 
his experience as a vocational counselor and as a reader o riet; 
literature (p. 5). He proposed that there are six types of re am 
investigative, artistic, social, enterprising, and conventiona = 3 d to these 
pirical studies showed that when individuals = a field, 
categories or types using a variety of means RE EEE, among the 
scores on inventories), there were demonstrable differences al behavior 
groups in how they described themselves and in their en arn 
(Holland, 1962, 1963, 1963-1964, 1964, 1968; Holland an 5 Im 
1964). Holland developed an instrument—the Vocational Malas ae 
tory (Holland, 1958)—for assigning individuals to types and su pian nr 
same time, other studies showed that environments could be ca i lari 
using the same typology (Astin and Holland, 1961; Astin, 1963). a 
Viernstein, Kuo, Karweit, and Blum (1972) showed later that a classi i o 
system derived from Dictionary of Occupational Titles job ee 
(McCormick, Jeanneret and Mecham, 1969; Jeanneret and en 
1969) could be related to Holland’s system of classification. In a aie 
Holland, Whitney, Cole and Richards (1969) demonstrated that D 3 Far 
cations within the system had specific relationships among themse i ah 
instance, people who are basically artistic types are more likely vault ô 
investigative or social subtypes than a conventional subtype. The eed 
this body of research is that the current theory asserts a relationship 2° yhich 
the personalities of individuals and occupational environments in eat 
they work, as well as a relationship between the types of individuals Jes 
their vocational behavior, such as employment stability and such u a 
as job satisfaction. Research has expanded and changed the Henn 
comparison of the 1966 and the 1973 formulations will show. Ho pae 
counted over 100 studies stimulated by his theory in 1973 and mee 
many more by now. Because the theory is becoming more precise, er 
well-defined concepts and clearly derived predictions, it will probably 
tinue to change and grow as a result of this research. sing 

Because the theory relates individuals and jobs (environments) tes 
the same Category system, it is extremely useful for vocational counse ee 
Holland (1973) suggests several ways of assessing the personality ish 
individuals and provides a listing of occupations according to that typ the 
i tions Finder (Holland, 1970). Obviously, this gain Be 
for clients is based on growing and changing theory so t ed. 
Cannot afford to assume its stability. However, practice has been ee 
Thus, practice and reading research led Holland to develop a theory t 
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was changed and expanded by research and that ultimately influenced prac- 
tice. This illustrates precisely the relationships suggested by Figure 2.1. 

If knowledge moves in only one direction across the arrows in Figure 
2.1, or if one component is removed from the figure, the whole system 
suffers. If, for instance, Practice is removed from the system, then Theory and 
Research have no impact on the world of behavior and vice versa. Theory 
and Research are rendered sterile intellectual exercises and Practice is de- 


Void of any rationale. 


The Counselor's Responsibility 


The counselor is a kind of intermediary who works between the pure sci- 
ence of psychology and the needs of human beings. The quality of the 
Counseling service provided is an ethical concern, yet the practicing coun- 
Selor is not usually found pondering over the latest research in counseling 
the way that a surgeon, for instance, ponders over the latest research into 
Surgical techniques. When a counselor neglects the latest knowledge in the 
field, such neglect is a tacit affirmation that the counselor believes counsel- 
ing is strictly an individualistic art form rather than a science-based profes- 
Stonal practice that can be taught. This is a legitimate position but not one 
that should be taken by practitioners who are at the same time arguing that 
Counseling should be limited to those with certain types and amounts of 
education. | prefer to view counseling as a skill that can be learned by a 


Wide variety of people (Egan, 1973). ; 
Only the counselor can take responsibility for the quality of service 
Provided, The nature of the counseling service, the way counseling is 
evaluated by employers, and the position of the client make it nearly impos- 
Sible for anyone else to take that responsibility. er 
Since the product offered to the public is intangible, and the criteria 
Used to determine its effectiveness are usually quite subjective, it is easy to 
assume that the job has been done well because the client “feels better” or 
terminates. Because there is no right way to deal with any particular 
Client—only a way that works in a particular client-counselor 
'elationship—counselors are very much “‘on their own” regarding treatment 
of clients. To assume they can get no help from reading and thinking about 
heir work negates the idea that counseling skills can be taught and im- 


ti 
Proved by knowledge. _— 

Counseling agencies have been at a loss to evaluate counseling for the 
Same reasons—because it is SO intangible and because there are various 
Means to the same ends. Most often the criterion applied has more to do 
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with quantity than quality. Thus, hours of client contact or number of closed 
cases may serve as indicators in some agencies but these criteria have only a 
tangential relationship to quality or effectiveness. Even the client is not na 
very good position to evaluate counseling. If a positive result is obtained an 
clients are pleased about the results of counseling, they rarely question 
whether more effective and efficient methods might have been used. If on 
the other hand, clients are dissatisfied, it is difficult to pinpoint the source ol 
their complaints without referring to personal issues. Most clients are unwil- 
ling to do this. aed 
Only individual counselors are in positions to improve their skills an 
understandings by a thoughtful attention to current research literature. Em- 
ployees, clients, even bodies that give certificates and licenses on the basis 
of past education and performance cannot insure that counselors do every- 
thing in their power to provide the best possible service. ; 
Likewise, only practicing counselors can direct pure scientists to IM“ 
portant problems for research. Thus, we arrive at the conclusion that coun- 
selors must know about research to improve their practice, so that they can 


engage in the research process themselves, and so that they can influen¢ 
the research being done. 


BACKGROUND NEEDED 
FOR READING 


COUNSELING RESEARCH 


> a or r 
In order to read counseling research effectively it is important for the renna 
to understand how theories are developed and tested. Understanding of t 5 
more technical research elements such as measurement, statistics, and r 


a 5 $ z te 
search design is useless unless there is an understanding of how they rela 
to theory development. 


Theory Building 


Theories are sets of definitions and statements specifying the relationships 
between the defined concepts. They help us to understand the world aroun 

us, to predict what will happen next, and ultimately to control those happe™ 
ings. For instance, if it has been demonstrated that a certain set of conditions 
and behaviors are likely to produce addictive personalities, then we cê" 
intervene in the experiences of an identified group who live under n 
specified conditions and exhibit the specified behaviors to help prevent u 
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development of addictions. The counselor may be the intervenor but the 


theory helps indicate when and how to intervene. 

Note that while a theory usually starts out as a belief held by a person 
or group, this belief must ultimately be tested and confirmed. If we believe 
that a certain set of conditions and behaviors contribute to the development 
of addictive personalities, the relationship must be demonstrated une- 
quivocally. This demonstration is called research. Usually the idea that a 
relationship exists is based on observation in the same way that Newton 
noticed that objects fall toward the earth and that Freud noticed that sexual 
repression occurred in his neurotic patients. 

This type of reasoning is called “inductive” and it is characterized by 
Starting with specific observations and making general statements based on 
them. However, there is always the danger that what is observed in specific 
Cases is not, in fact, general; that, for example, more objects fall away from 
the earth than toward it or that neuroses are not all rooted in the displace- 
Ment of sexual energies. For this reason, it is important that theories stated in 
general terms be logically consistent (that is, not violate the rules of formal 
logic) and that the implications of the theory be tested. Even if the scope of 
the theory is quite narrow, it is important that we ask how the general theory 
can now be tested in specific cases- This involves “deductive” reasoning 
from the general case to the specific case. The testing involved here usually 
Occurs under much more rigorous and controlled conditions than the obser- 
vations involved in inductive reasoning, although deductive reasoning 15 


Surely a type of observation. 


For an empirical test it is necessary that the concepts of the theory be 


defined precisely and that the hypothesized relationships between them be 
Stated explicitly. Once this is done, a test is conducted under controlled 
Conditions that minimize the chances for the outcomes to be attributed to 
any factors other than those hypothesized in the theory as being causal or 
related to the outcomes. Actually, such tests are never as comprehensive or 
8eneral as the theory itself, so 4 successful empirical test can only be said to 
Contribute to the confirmation of a theory, not to “prove” It. red 
The most difficult problems in setting UP research studies designed to 
test theories include defining and putting constructs into operation 
(“operationalizing’” them), stating the hypothesized relationships in Hn 
that are testable, and controlling all the extraneous variables. Control o 
Variables is especially difficult when the theory in question 1s a theory of 
Uman behavior because we have moral inhibitions and ethical prohibitions 
against intervening in certain ways in the lives of other human beings for 
Such abstract purposes as increasing knowledge and conducting research. 
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Operationalizing Theoretical Constructs 


Dictionary definitions of words and ideas are made up of other words. In 
ordinary conversations these definitions serve quite well, although problems 
in communication can often be traced to a lack of precision in how different 
individuals define abstract concepts such as “love,” “trust,” and beauty.” 
For psychological research Purposes, it is necessary to define the concepts 
being studied in such a way so that we know precisely when a certain trait or 
behavior is present and often in what quantities it is exhibited. This is called 
operational definition. For example, Auerswald (1974) did a study of the 
effects of restatement and interpretation in the counseling interview. She 
wisely noted that it was important to specify in behavior terms what a 
“good” effect or positive change in the client is. She chose to use client 
expression of affect in the interview as her criterion of a “good” change in 
client behavior. But a very precise method was used to measure affect. 
Counseling interviews were taped and then typed. A specific procedure was 
used for breaking each typescript into smaller units of analysis and for 
determining whether or not each unit contained a self-reference affect 
statement. The resulting Proportion of affect responses served as an opera- 
tional definition of client expression of affect and ultimately of client 
change. It is important that every concept involved in a research hypothesis 
have just such a specific operational definition. Obviously, if Auerswald had 
simply said she was interested in the relationship of restatement and in- 
terpretation to client change without specifying exactly what kind of client 
change and how it was measured, her results would be quite useless to 4 
Practitioner trying to explore the relative effects of the two techniques by 
reading research reports. On the other hand, to argue that all that is meant 
by the positive effect of counseling is an increase in the proportion of affect 
responses made by the client is ridiculous. This is a good illustration of how 
operational definitions always narrow the concepts they define at the same 
time as they sharpen our understanding of those concepts. It also illustrates 


er nfirm a theory, not to prove it. 
ther concepts have been operationalized by standardized tests, ques- 


. For instance, the early intelligenc® 
try by Terman (1916) helped to 
concept of human intelligence. Woodworth (Symonds, 
neuroticism in alien Pee called the Personal Data Sheet to detect 
Personality invent iers, It served as a Prototype for many more modern 
characteristi ories that are used to operationally define personality 

istics. As to physiological measures, Droppleman and McNa!! 
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(1971) have introduced a finger sweat print as a method of operationally 
defining anxiety. 


Measurement—Means to Operational Definition 


Basically, an operational definition includes a statement of how the concept 
defined can be measured. It is at the level of operational definition where the 
whole science of measurement becomes important to counselors who want 
to read and understand research. And, of course, measurement principles 
are also important to counselors who use tests in their work with individuals. 
There are a number of books that cover both aspects of this topic admirably 
and at length so that only a limited discussion of the problems of reliability 
and validity is offered here. Textbooks by Anastasi (1976), Brown (1976), 
Cronbach (1970), Horst (1966), and Tyler (1971) provide good introductions 
to psychological measurement in the context of standardized testing. Levine 
and Elzey (1970) and Miller (1972) cover the same topic in programmed 
format. Guilford (1954), Gulliksen (1950), and Magnusson (1966) treat 
Measurement from a more theoretical viewpoint. Goldman (1971) covers 


the applications of measurement in counseling. 


ant to note here that unless the procedure by 
s reliable, that measurement is useless. If my 


Scale weighs the same object at 5 pounds today and 10 pounds tomorrow, it is 
quite useless in determining how much an object really weighs—it is unreli- 
able, Although the above books discuss various types of reliability, the ones 
Most important for good operational definition are stability over time and 
Stability over raters. If | use a standardized test or questionnaire as an opera- 
tional definition of a trait or attitude, I want to know that if nothing changes in 
the individual | will get approximately the same score if I test the individual 
tomorrow or next month or next year. The reason the test must measure with 
reliability over time is that | want to be able to attribute changes in the scores 
of individuals or groups of individuals to the effects of some intervention 
such as counseling—rather than to instability in MY ARE 
As a journal editor, | find that researchers often conduct research using 


elaborate designs in which they control for error from every source except 
rom their measuri instruments—the inventories, questionnaires, and 
Pe individual belongs or whether 
g instrument is synonymous 
ubjective 


RELIABILITY. It is import 
Which a concept is measured i 


an indi 
With 
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scoring procedures, or poor testing conditions. Yet it is so unusual for re- 
searchers to provide reliability estimates for the various unpublished ques- 
tionnaires and surveys they use that one of my consulting editors recently 
wrote me anote extolling the virtues of an author whohad provided reliability 
information in the manuscript | sent him for review. o. 

Stability over time is most often expressed as a correlation coefficient 
between scores on two administrations of the same test. These coefficients 
can range between — 1.0 and +1.0 but in reliability estimates they are most 
likely to range between O and +1.0. A correlation of 1.0 would indicate 
perfect reliability, which is never found in psychological instruments. It 15 
not unreasonable, however, to expect correlations in the .80 to .95 range. The 
higher the correlation coefficient, the more reliably and stably the instrument 
measures. ; 

When raters assess behavior as they did in Auerswald’s study, their 
reliability can be expressed as a correlation coefficient between the ratings 
of two raters or as a percentage of agreement between them. It is important, 
if the ratings are to be used to express change, that any changes found can 
be attributed to the treatment or intervention—in Auerswald’s study it was 
restatement and interpretation—rather than to error and instability of judg- 
ment in the raters. 

Whenever a concept is operationally defined, as it must be in research, 


a Statement about the reliability of the measuring process inherent in that 
Operational definition should be given. 


VALIDITY. There should be some evidence that the measuring process 
measures what it is supposed to measure. This is called validity. Validity '§ 
discussed in detail in the textbooks mentioned earlier but the kind of validity 


most essential in research is construct validity (Cronbach and Meehl, 1955; 
APA, 1974). 


Construct validity is inferred from evidence that scores on the test are 


related to appropriate behavior and attributes, or scores on other measures 
for which such evidence is available. Often the appropriate relationships 
must be predicted from the particular theory the measuring instrument 1$ 
designed to help Operationalize, and considerable research must be done ON 
the Instrument before it can be used to advance research on the theory. For 
Instance, the Career Maturity Inventory (Crites, 1973) was designed tO 
ty as hypothesized by theorists who propose a de- 
1951; Su individual careers (Ginzberg, Ginsburg, Axelrad en 
construct validit ihe 1957). One of the pieces of evidence for t : 
Crites (1965) h A „> Instrument is that scores increase with grade, 4 

Ypothesized that they should in a developmental inventory: 
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Various paper and pencil measures of intelligence that are more easily 
administered and scored than individual measures of intelligence demon- 
strate construct validity by indicating their relationship to individual meas- 
ures of intelligence. In these cases it is possible to represent the amount of 
relationship between scores on the instrument in question and behavior or 
other test scores by computing a correlation coefficient between the two sets 
of measures. Thus, validity can also be expressed as a Coefficient ranging 
from —1.0 to +1.0. Occasionally a negative correlation, which indicates an 
Inverse relationship between the variables correlated, gives important evi- 
dence bearing on the construct validity of the measures (Campbell, 1960). 
Validity coefficients are not usually as high as reliability coefficients; +.40 
to .60 represents a reasonable range for validity coefficients. The books cited 
above give more detailed information on how to determine the adequacy of 
Validity coefficients and they also discuss other noncorrelational ways Of 
expressing reliability and validity. P 

Any measuring procedure used to operationally define a concept for 
research purposes must have both reliability and validity. 


Testing Hypotheses 


Every research study is undertaken because there is a question. This is 
Sometimes difficult to see because researchers do not always state the under- 
lying question explicitly. Nor do they always state the research hypothesis, a 
statement about what relationship they expect 10 observe or what kind of 
Change they expect to bring about. It is important for a researcher to consider 

Ow results contrary to the hypothesis of the study might be 
explained—before the study is begun. Too many studies have been com- 
Pleted in a burst of enthusiasm, only to have the researchers find that the 
results neither give a clear answer to the underlying question ee 
a much greater understanding of anything. A manuscript of this type Is usua i 
'eturned to a journal editor from a reviewer with the comment: “| canno! 


Underst n 
and why this study was done. 

i oc to 

Unfortunately, there is usually nothing the author can mah 

Salvage the study when the problem is that the scm we a Am 
Clear und i archer wanted to do. >0 

erstanding of what the rese va k ° 

SPecific das nail “nal definitions of the important con 
problem is with the operationa ; 

Cepts; either the important concepts were not operationally defined at all, or 


a Measure with poor reliability or validity was used. Sometimes the i 
Problem is that the study was designed in such a way so that the importa 


Vari 
lables could not be isolated. 
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Some questions and hypotheses cannot be answered or tested because, 
although we know what it would take to confirm a specific hypothesis, we 
cannot do that thing and therefore cannot test the hypothesis. Carnap (1953) 
made this distinction between confirmability and testability. For instance, 
the hypothesis “A three stage rocket launched from earth can land on the 
moon” was confirmable but not testable until a solid fuel was developed 
that could be used to power such a rocket over the distance. 

In another case, we might hypothesize that children raised in Skinner 
cribs (Skinner, 1945) will exhibit less social behavior than children not 
raised in Skinner cribs. To test this hypothesis we would need to start with a 
sample of babies, all from the same population, and randomly assign them 
to one treatment or the other, specifying exactly how the outcomes would 
be measured. This hypothesis is confirmable because we do know how to 
test it, but it is probably untestable because it is extremely unlikely that we 
can find a sample of babies available for random distribution to either 4 
Skinner crib environment or a nonSkinner one. Because parents feel quite 
strongly about the early environment of their babies, itis not likely that many 
would agree to participate in such a study. Those babies whose parents are 
willing or who have no parents to object would probably live in situations 
that difrer substantially from those of most children in our society, so the 
general hypothesis when applied to all babies would not be tested. 


Research Design 


Good research design insures that a testable hypothesis, with its CON 
cepts well operationalized (another way of saying this is that its variables are 
well measured), actually is tested. In testing any specific hypothesis, the 
researcher has dozens of decisions to make. The way these decisions are 
made dictates whether the hypothesis is adequately tested. Some of the 
decisions include answers to these questions: Who will be studied? HOW 
will they be assigned to treatment groups? When will measurements be 
taken? What variables, in addition to those included in the majo! 
hypothesized relationships, will be included in the design so that their ©" 
fects can be studied? Although this section only describes briefly some bas!€ 
Principles of research design, there are many books covering the subject at 
length (Campbell and Stanley, 1963; Myers, 1966; Borg and Gall, 1971; 


Keringan 1973). Johnson and Solso (1971) present a very effective cas® 
y approach to understanding experimental design. 


SELEC 
a E The people or units chosen for study should be 
Ve OF söme larger group to whom the findings will be 
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generalized; this is much easier to understand than to implement, however. 
It is difficult to secure the cooperation of representative groups of children, 
parents, workers, nonworkers, believers, atheists, clients, and nonclients. 
Therefore, the people chosen for study are often those whom the researcher 
can control to some extent. The most popular group used in counseling 
research is students in institutions where researchers work. A report by 
Holcomb and Anderson (1977) shows that few studies on students in techni- 
cal or community colleges, workers, handicapped persons, or elderly peo- 
ple are conducted in the area of vocational guidance despite the obvious 
need for research using these populations. The group studied certainly influ- 


ences the usefulness of research findings. 


Some kinds of research designs do not really assign 
people to different groups at all. Whenever the researchers cannot assign 
People to groups, a great deal of control is lost and the resulting designs give 
less definitive information. This is the case whenever a researcher studies 
Only one group or two or more different but already existing groups. In studies 
on only one group, the researcher usually wants to say that an experience that 
the group has had (e.8., incarceration) or will haveasa result oftheresearch 
(e.g., a new type of counseling technique) has some specific effect. Unfortu- 
nately, if that effect is demonstrated, it is impossible to conclude that it is the 
result of the particular experience. It may have occurred asa result of some 
other experience or growth in the people, or changes in their society. In the 
absence of a comparison group that did not have the experience, Its impossi- 
ble to attribute the demonstrated effect to any Cause. 

If two different groups are used—one which has had or will have a 
specific experience and one which has not had the experience—any differ- 
ence between them cannot necessarily be attributed to the experience. It 
may be the result of initial differences between the groups. For example, an 
early attempt to assess the impact of counseling by Williamson and Bordin 
(1940) was open to criticism (Campbell, 1965) because it did not control for 
the fact that the counseled group, who were judged to be better adjusted and 
to have more appropriate career plans one year later, were different from the 
Control group in that the former sought counseling. Thus, it was impossible 
to conclude on the basis of the data (which did show some differences 
between the groups) whether the superior progress of the counseled group 
Was related to the experience of being counseled or to being the kind of 
Person who seeks counseling. Actually, Campbell (1965) did attempt to 
demonstrate that the observed effects were due to counseling by studying a 


Subgroup of the control group who sought counseling later. 
In all of these cases of single group Or different group designs, many 


ASSIGNING PEOPLE. 
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extraneous sources may influence the results and there is no way to control 
for them. On the other hand, whenever the researcher starts with one group 
of people and assigns them randomly to two or more groups or matches 
them and then assigns them randomly to two or more groups, the researcher 
can be much more definitive about the causes of whatever effects are ob- 
served. If the people come from essentially the same population and are 
assigned randomly, then one can conclude that any effects observed are not 
a result of the groups being different, of the growth of the people, or the 
effect of the society in which they live. Applying this principle, Volsky, 
Magoon, Norman, and Hoyt (1965) also studied the effects of counseling, 
but they randomly assigned students who sought counseling to an experi- 
mental group who received counseling and a control group who did not 
receive counseling during the period of the study. This procedure assured 
that any differences found could not be attributed to changes that would 


occur for most students with the passage of time or to differences between 
the groups initially. 


TIMING OF MEASURES. The timing of the measurements is also important. 
If one measures the status of the people in the study only at the end or u 
study, it is difficult to conclude that anything in the research caused the final 
scores although it may appear to be reasonable to do so if there are differ- 
ences between an experimental and control group at the end. Another aP“ 
proach is to measure both the experimental and control groups before an 

after the experimental group receives whatever special experience Or treat- 
ment is of interest. However, it is possible, in this case, to argue that the 
measurement changes the people in some way. For instance, if the incoming 
clients in a study are given a questionnaire on their attitudes toward the 
family before counseling and then are randomly assigned to counselor 
some of whom are trained as family therapists and others as vocationd 
counselors, it is possible that they may be alerted to the importance of family 
topics by the prior measurement. This readiness to talk about family top! 
would probably meet with differential acceptance by the two types of coun” 
selors. If the attitudes of the group counseled by family therapists chang® 


more than those of the other group, it is difficult to know what effect ur 
Pre-counseling questionnaire had in 

A pretest- 
However, a d 
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called ideal, it is difficult to implement because it requires more subjects and 
introduces considerable complexity to the practical arrangements for the 
study. 

Another example of how 
search design is in time series stu 


the timing of measurements is used in re- 
dies. In these, one group of people is 
measured repeatedly to determine whether important changes have occur- 
red over time. Between two of these measures an experimental treatment is 
introduced. If a greater change is observed during this period, it is attributed 
to the treatment. For instance, if a sample of students receive grade reports 
every six weeks, it is possible to observe whether the fluctuation in grades is 
greater from beginning to end of a six-week period when counseling groups 
designed to increase motivation to do well and to give assistance in develop- 
ing good study habits is offered than from beginning to end of other six-week 
Periods. This method controls for the effect of the measurement itself, and 
for the effects of maturation in the individuals, assuming this maturation is a 
relatively smooth process, but the effects of external events are not ruled out 
by this design. If the PTA simultaneously held a meeting on the merits of 
Paying students to get good grades and 75 percent of the parents in school 
decided to adopt this practice, it would be impossible to determine whether 
any increase in grades should be attributed to the group program or the 


Parents’ promise to pay. 


interested in the effect of a treatment 
me (the dependent variable), other 
ables must often be taken 


VARIABLES. Even if the researcher is 
(the independent variable) on the outcor 
Potentially important influencing factors Or vari 
into account, 

Although the resear 


Counselin s fic bi 
g technique or a specific Dene’ < j ein 
Now if the ea is differentially effective for clients of different ages, 


Sexes, ability levels, or socioeconomic levels. If the technique works best for 
emales ata certain agé, it is important that the study be planned to allow for 
testing that possibility. Thus, planning a study requires an ability to choose 
Which independent variables may be fruitfully incorporated in the research 

sign. This ability may be intuitive but it is more likely to be enhanced by a 


Wide knowl ious research. ; 
The ee A sarah included in a research design may be a 

Us status variables such as sex Or they may be measures of constructs like 
anxiety” whose presence and level are inferred from scores on ee 
tory, These measures must have adequate reliability and validity if the pur- 


Pose of ri 
the study is to be fulfilled. . , 
he way ia independent variables are incorporated in the research 


cher may be interested in the effect of a certain 
ehavior, it may also be important to 
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i f, i esign 
design is as important as a sie pes rt eit lens raed, 
s for contrasting the effects o * Yallable S uk 
= nn combinations with other independent a. n 
it is not always possible to use such a design because ns er aan 
the independent variables do not occur independent yin d A A 
studied. For instance, if a researcher determined that both ole ara ak 
important independent variables in a study of the effects of gonn aetan Ë 
ing, the effects of sex and race could not be studied in a facto ae ae ie 
only black females and white males were available for ‘ede nz 
study. A more definitive study could be designed if nern pres 
all four possible combinations of these variables were available. u 
A knowledge of experimental design is necessary for doing | 
and a knowledge of why good design is important is necessary ad mene 
research critically. Overall, the researcher must make decisions wm ie 
ple, assignments to groups, timing, and important variables in | 
good research. The researcher must also determine a method er alls 
analysis to be used in analyzing the data once they are collected. 


Statistical Analysis 


. “u hese 
Basically, statistical analysis helps us to answer the question: Are th 
findings important or could they have occurred by chance? looked 

As a graduate student, | once collected data fora study and then ee 

for a statistical test that would answer that question, using the data eae 
collected. To my chagrin, | found that there was no such test. a aes 
are times when it is appropriate to present data without benefit of = = ine 
analysis, For instance, statistical significance seems superfluous w! How 
data show large differences that are of obvious practical importance. ani 
ever, because one never knows what the data will show until after as be 
collected, it is imperative that choosing a means of statistical analys 


il after the 
incorporated into the planning of a research study and not left until aft 
data are collected. 


plain them, ©.8., McNemar, 1969; Blalock, 1972; Ferguson 

and Fruchter, 1973; Mendenhall 

1956; and Winer, 1971), Tanur ( 

case study approach and Terra 

med units for the study of stati 
For our Purposes it is most 


l find- 
'mportant to understand that research 
ings usually involve a Comparis 


5 y ion oF 
on, whether with a theoretical expectatio 
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a comparison group. For instance, Hanson and Rayman (1976) compared 
how well two types of interest inventory scales classified college-bound men 
and women into vocational preference groups. They concluded that both 
types of scales had a hit rate that was far better than what would have 
resulted from random assignment. The hit rate for random assignment in this 
case was derived theoretically, a technique sometimes used in studies. The 
authors reasoned that if the people were randomly assigned to five 
assignment had one chance in five of being correctly as- 
nly 20 percent would be correctly 
stion classified nearly 40 percent 
luded that both types were quite 


Categories, each 
signed, and that over the whole group © 
classified. Both of the types of scales in que: 
of the people correctly, so the authors conc 


effective. 
Unless statistical tests are applied, observed differences may appear to 


be large and meaningful when, in fact, they are not. The number of people 
Studied, the distribution of their scores (which operationally define some 


Concept) are all factors entering into the determination of whether the find- 


ings are “statistically significant.” This term is used to indicate that there is a 
low probability that a given finding could be attributable to chance factors. 


An acceptable level of probability is specified. Levels most often specified 
are .01 and .05, meaning that there are one and five chances in one hundred 
that these results could be obtained by chance in situations where, indeed, 


there is no real difference. 


With a basic understanding that the concepts utilized in research must 


be operationally defined, and that they are often defined by psychological 
Measuring techniques, that the hypothesis must in fact be testable, that good 
research design insures a clear test of the hypothesis, and that statistical 
methods allow us to understand the importance of the findings, we can now 


examine various types of research. 


These basic understandings should be supplemented by more detailed 


reference material. Every counselor’s library should contain at least one 
textbook in each of the following areas: measurement, research design and 
Statistics (listed previously), as well as a good general work on research 


(Arnoult, 1976; Asher, 1976; Helmstadter, 1970; Hopkins, 1976; Runkel 
and McGrath, 1972). Hardyck and Petrinovich (1973) and Millman and 
Gowin (1974) are particularly helpful general books for those who wish to 
earn to read research because they utilize the case study approach. 


TYPES OF RESEARCH 


e interact as indicated in figure 2-1. 


Basically, theory, research, and practic zur 
| real world level and influence 


Some types of research begin at the practica 
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theory. Other types of research begin at the theoretical level and ultimately 
influence practice. The first type of research is essentially descriptive or 
survey research designed to answer the question “What have we here? in 
an inductive fashion. Descriptive research helps to understand a given situa- 
tion. The second type of research is designed to aid us in spelling out 
relationships between the elements of a theory. It is designed to answer 
questions like “If we did this, what would happen?” This is a deductive 
approach to research. , 

Among the types of research discussed in this section, the descriptive, 
correlational, causal comparative, and historical are basically inductive, 
while the experimental type of research is deductive. 


Descriptive Research 


Descriptive research helps us to describe the current situation. We often do 
descriptive research when we want to find out whether a hunch we have I 
borne out by the data. For instance, in 1968 Strong wrote an article in which 
he drew on social psychology to make some hypotheses about the nature ol 
successful counseling. One of his ideas was that counselors who are pel 
ceived as expert by their clients will be more effective in influencing theif 
clients. To find out how clients actually did perceive expertness in coun 
selors, Schmidt and Strong (1970) taped interviews between six counselor 
at different levels of expertise as indicated by education and experience an 
one person playing the role of client. They asked students (who were not rea 
clients) to listen to the tapes and rate the counselors in terms of expertnes 
and give the reasons for their ratings. They found that the students did not 
rate the counselors in accord with their expertness as defined by the author: 
However, the variables identified by the students were used to define expert 
and inexpert roles in a subsequent study of expertness and influence m 
counseling (Strong and Schmidt, 1970). This study helped expand our UN 
derstanding of how people perceive expertness in counselors; as it tume 
out, the results were contrary to the authors’ hunches. It is a good example © 
why it is necessary to do descriptive research. 


FIELD AND LABORATORY SETTINGS. 

either inthefield orin laboratory. Field resea 
situations. For instance, anthro 
observes the on 


ad ace 
Descriptive research can take pl 


rch is conducted in real, ongoing life 
pological research where the researcher actua P 
going process of a society is field research. So is the MO y 
i research in which an observer uses a aneno 
scribe the behavior of subjects in natural setting : 
work without influencing the situation being ° 


THE COUNSELOR AS CONSUMER OF RESEARCH 49 


served, whereas when the observer is perceived by the subjects it is likely that 
their behavior will be changed in some way. Brandt(1 972) discusses research in 
Natural settings at length and Webb, Campbell, Schwartz, and Sechrest (1966) 
examine how the researcher can actually measure important variables in natural 
settings. 


Laboratory research is not done in-a natural setting. Instead, the sub- 


jects are brought into some new situation for purposes of participating in the 
research. There are particular problems involved with descriptive research 
of this kind. Subjects must agree to participate and often they are only 
analogous to the group the researchers are really interested in. In the 
Schmidt and Strong study (1970) described above, the authors were in- 
terested in how clients would perceive the expertness of counselors. The 
Counselors they used were real but the research subjects were male students 
in introductory psychology classes. Obviously, the authors wanted to 
generalize from these subjects to all counseling clients. However, whether 
Counseling clients and introductory psychology students react similarly to 
Counselors has not been demonstrated. Schmidt and Strong might have 
attempted to engage clients currently in counseling or past clients, or even 
clients being held on a waiting list to participate in their research. Even if 
they had, it is doubtful that all the clients requested to participate would 


have done so. Whenever participation rates vary substantially from 100 


Percent, the unanswerable question of how the nonparticipants vary from 


the participants can be asked. Research done in laboratory settings must 
always confront the issues of generalizability and participation rates. 
Descriptive research in which subjects are asked to complete tests and 
questionnaires either in a laboratory setting or in a mailed format are most 
like laboratory studies in that the participants are asked to do something that 
they would not naturally do in the course of their daily lives. The same 


problems of generalizability and participation rates apply. 


This descriptive research technique is bas- 
hological traits or behaviors are related. 
me measures of the variables of interest are 


employed and later correlated. A study by Westbrook a 976) illustrates this 
approach and is also a good example of how correlational studies can be 
Used to explore the accuracy of theories. Westbrook studied the relationship 
between Career Choice Competencies and Career Choice Attitudes as 
Measured by various scales of the Career Maturity Inventory, the Career 
Development Inventory, and the Cognitive Vocational Maturity Test. Each of 
the ten scales on the three instruments was classified as either a measure of 
Career choice attitude or competency. Crites (1965, 1974) had previously 


CORRELATIONAL RESEARCH. 
ically used to explore how psyC 
In correlational studies, SO 
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predicted that within each area the correlation among 
the .50’s and .60’s, while between the two areas correlations a Fe cect 
ures would be only in the .30’s and .40’s. Westbrook explored ci en 
of Crites’ predictions by administering all three inventories to mt a ne 
and intercorrelating their scores on all 10 of the scales. This resu e Ai 
correlation coefficients that were arranged within the two areas eee 
level of relationship between each pair of scales and within and be 
f measures. f 

p supported some of the specific hypotheses We 
derived from Crites’ theory but not all of them. Table 2-1, which is 
from Westbrook’s article, illustrates a correlational table that includes etek 
and standard deviations for all the variables as well as the corre m ‘ll 
between them. The correlations between competency measures ee 
above .50, but none of the correlations between attitude measures me 
above .50. Correlations between measures of attitude and measures eo 
petency ranged from .04 to .64. These findings from a correlational stu Tiy 
helpful in illustrating one additional point. It is difficult to know in ae the 
where some of the hypotheses were not upheld whether the fault is wi ai 
theory from which the hypotheses were derived or from the measures meen 

Another analysis that Westbrook employed in an attempt to ee 
the relationships among the ten variables was factor analysis. may 
analysis is a statistical means of asking how many factors or dimensions Aby 
be used to explain a set of correlation coefficients such as those derive bi 
Westbrook, and how much of the variability in the obtained scores enn 
explained by those factors. In his study, Westbrook found two fac er 
roughly corresponding to the attitudinal and competency dimensions, i 
Crites’ theory suggested. However, one of the attitude measures (The Ca hly 
Maturity Inventory Attitude Scale, Number 1 on Table 2-1) was more T 
related to the competency measures than to the other attitudinal ma à 
Another way of saying this is: “One attitude measure loaded highly can 
factor that contained other competency measures.” Factor loadings of 
themselves be defined as correlation coefficients between each nn that 
a factor representing a kind of summation or average of several variables in 
are related. Correlational techniques and factor analysis are discusse 
much more detail in many of the statistical textbooks cited earlier. „tañ 

It is important to remember that correlational studies show en 
or relationship but do not show causation. As a result of a correlational st a 
we can say what traits or behaviors occur together in a given population 
we cannot conclude that one caused the other. + the 

When correlation Coefficients are high, it is possible to predict of 
scores on one variable (called the criterion variable) from a knowledge 
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; 3 f 
scores on another variable (the predictor variable) with epee deed 
accuracy. This process is called regression. It is also possible ch 
more than one variable at a time with a criterion variable to ae pri cern 
contributes to the strength of the relationship or to find the best a + elled 
of measures to be used in predicting the criterion variable. This is 

Itiple regression. ame 
= u Be when it became possible after World War | chee 
dents with paper and pencil measures of academic ability, counse i A ne 
interested in two questions that could be answered by ee ain} 
search. First, are academic ability and grades in school related? sie yen 
grades in school be predicted from measures of academic ability? Pe are 
swers, of course, were that academic ability and performance or gra al 
related but that the obtained correlations (usually about .60) do not ac ei 
for all of the variability in the sets of scores. To determine what Te 
the variability in a set of scores is explained by the relationship pa S De 
variables, the correlation between them is squared. Thus, if the corre’ aa 
between an ability measure and grades is .60, then 36 percent of ne er 
iance in grades can be attributed to ability and 64 percent mua, ne 
counted for by other factors. Nevertheless, scores on ability tests can nié 
to make broad predictions about grade attainment in specific aca 
situations. hown in 

For instance, one can make up the kind of expectancy table s ne don 

table 2-2 that shows the relationship between ability and grades hass 5 
actual experience in a specific college. In this fictitious example, nce 
students entered as freshmen. The distribution of their scores on the io 
exam, a measure of college aptitude, is described in the first two af the 
For each subgroup, the row reflects their experience. For instance, © 
150 students who scored between 91 and 100 on the entrance N er 
percent obtained a grade point average (GPA) of less than 2.00 for el 
year; 45 percent obtained GPA’s between 2.01 and 2.99; and 35 per ela- 
obtained GPA’s of 3.00 or above. It is clear from Table 2-2 that the a es 
tion between scores and grades is not perfect. Some other factors bes au“ 
ability must be influencing GPA. Yet, the table provides a prospeetn S is 
dent at Fictitious University with a probability statement about that stu ces 
Performance. If the student scores between 51 and 60, there are 65 on 
in 100 that the student will earn a GPA above 2.00 based on the exper!€ 


- wil? 
of other students with scores in the same range who enrolled at that un 
sity. 


nt 
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TABLE 2-2 
EXPECTANCY TABLE FOR FRESHMEN GRADES 
Fictitious University 
(N = 2000 freshmen) 


7 CHANCES IN 100 OF 


Obtaining Obtaining Obtaini 
— . a a GPA between a = 
Nenn — GPA of 2.00 2.01 and 2.99 GPA of 3.00 
ang amination N or below or above 
91-100 150 20 45 35 
81-90 225 20 50 30 
71-80 250 25 50 25 
61-70 300 30 50 20 
51-60 400 35 55 10 
41-50 300 40 55 5 
31-40 150 45 55 0 
21- 30 125 50 50 0 
11-20 75 60 40 0 
75 28 0 


01-10 25 


emedial work will help a low scorer on 
d the grade point average predicted?” 
an experimental study. 

d in field or laboratory settings. 
of behavior to measures 


such questions as, “What type of r 


t l : 
he academic achievement test excee 


TI : 
Nat question can be answered only by 
be conducte 


N Correlational studies may 

hr € variables correlated can range from observation 
Ds A : r 
psychological traits or attitudes. 


The use of correlation rests on an assumption that we are looking for a 


pea relationship. For instance, if 100 percent of the a ie! who score 
the ra 80 in Table 2-2 received a GPA of 3.00 or more an a, of 
fa at) who scored below 20 also received a GPA ot 3.0 or more, 
ional correlational analysis would probably tell us there is no relation- 

ally, there would be a 


Snip b 
etween the c itude test an GPA. Actu 
he college apt both variables increase 


relati 

i : ma 
tone but not a linear one where scone both VAS he al 
y er or where s e variable go UP while scores on the other 
ar e scores on one Vet“ 


‘able go down 

Cor N d : 
ables of relational studies must use reli 
cause interest. If the grade point avera 
athletics A athletes are given A’s on the b 
abili S then it will be difficult to fin 


a 
nd GPA even though one may 


and valid measures Ol the vari- 
a given school is distorted 
heir participation in 
en academic 
On the other 


able 
ge in 
asis of t 
tionship betwe 


d a rela 
tudents. 


exist for most $ 
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hand, if the measure of academic ability used is unreliable or en 
time, any relationship between academic ability and periormance ma 
day and gone tomorrow. 

ee the Rie pore characteristics are measured in correlation ae 
deserve particular attention because they must be representativ ae ta 
population the researcher is interested in if the results are to be use lege 
correlation is found between two variables in a population of co ac 
sophomores (who are often available for studies of this type), can ner Mn 
tionship found be generalized to all adults? There are obvious differe men 
age, scholastic ability, and socioeconomic status that cannot be len oF Hs 

Not only must the people measured represent the population en 
terest, but there must be enough of them to insure that the resulting EN a 
tions are quite stable. Correlations based on fewer than 25 or 30 cases 
not usually meet this criterion. deat 

Because the measurements for correlational studies are usual ly mi For 
one time, they usually do not help us to understand temporal inven 
instance, a researcher might find a high relationship between oie = 
gifts and purchasing fir trees if the study was conducted in the mar ae 
December and no relationship at all between the two if the study 
conducted in June. asures 

Correlational studies are extremely valuable in showing what me & 
vary together. They tell us nothing about the absolute levels of the varié “ibe 
studied, temporal relationships, or causation. When the intent is to desC 
relationships, correlational studies are appropriate. 


CAUSAL COMPARATIVE RESEARCH. One w. 
ing of causation is to 
their history for diff 
speaking, this is stil 
determini 
may be i 


ay to attempt an understand 
study two groups that differ in some way and to ctl 
ering factors that may explain the differences. a of 
| descriptive research, which is not really capa? tha 
ng causation. However, it is useful in describing differences 
ncorporated into subsequent experimental studies. N 


A study by DiMarco and Whitsitt (1975) is a good example: 
hypotheses were stated but 


this 
type of research and h 


f thei" 


the organizational struc s ae 
and interpersonal needs of the women and found certain difference? eis 
tween the groups. Be asures were taken in the present me 
really no temporal difference that can be hypothesized to cause the 
ence. In fact, the auth 


A ssi 
Ors point out that their results suggest two PO 


iffer” 
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interpretations: (1) organizations hire people like those who already work in 
the organization, or (2) organizations change people after they are hired. It is 
extremely difficult to design a causal comparative study that does not pre- 
sent this type of problem. 

Those causal comparative stu 


that differentiate between the groups in 
tion do not always lend themselves to further experimental study. A study | 


did (Harmon, 1972) is illustrative. In comparing women persisters and non- 
PE in three college curricula, one of the most significant differences 
etween the two groups was that the persisters were more likely to be 
first-born, That is clearly a temporal difference that suggests causation. 
Bu no experimental method for testing the relationship is available 
because of social prohibitions against controlling conception and childrear- 


Ing practices. 
ii aozel compare studies ca 
ea ser that temporal differen 
ee and that those differences once ! 
Ous examination. 
asically reflect what exists now. They 


A All of these descriptive studies b / 
are useful in that they suggest directions for future research and also define 


Problems. 


dies that do find the variables in the past 
a way suggestive of specific causa- 


n be heuristic but the researcher must 


ces implying causation are really being 
dentified are amenable to more 


Experimental Research 


a population of subjects that can be 
t groups. Experimental research 


5 most often conducted in a laboratory setting although field experiments 
an occasionally be carried out. For instance, in educational settings it is 
ms as a unit for one treat- 


Someti : 
$ Metimes possible to randomly assign classroo 
Nent or another—the experimenter wants to be able to say that the only 


ference between the groups was the treatment they received. Thus, any 
Change after the treatment can be attributed to the treatment itself, not to 


extraneous variables. A good experimental research design does allow us to 
Make statements about causation. For instance, if a sample of individuals 
domly assigned to two treatments 


who are deficient in certain skills are ran 
€signed to alleviate that deficiency, and one group makes better progress 
an the other, we can assume that the treatment caused the progress and 
at if the groups were reversed, the group Now receiving the effective 
andom assignment assures 


tr 
€atment would be the one to make progress. Rand 
at every subject has as much chance of being assigned to one treatment 


Thi x $ : 
his type of research always begins with 


ra 
is ndomly assigned to two or more treatmen 
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$i . jects as- 
group as to another. Consequently, the oe of in es a 
signed to each treatment group should be pretty typice 
A : ol- 

a independent variables in an experimental design air te spalied 
led by the experimenter. They include the various [nn h question 
but they also include variables thought relevant to the eras ils rest, If 
such as age, sex, socioeconomic status, or score on a N: can be 
the experimenter controls each of the variables so that its etfecis 
known, less is left to chance and more can be explained. asure OF 

The dependent variable in experimental research is the or inde- 
measures that the experimenter expects to vary in relationship 2 k ble an 
pendent variables. It is clear that this measure must be highly E ose an 
valid or the whole experiment will be worthless. For instance, URP iTS 
experimenter hypothesized that under certain conditions specific cyit 
produced electricity that could be collected and used to light an eal of 
bulb in a special apparatus. The experimenter might spend a great € on i- 
time and effort building the apparatus and creating and varying the had a 
tions, but if the light bulb used to measure the production of Ben woken 
broken filament that would never light, or would light only when the id be 
filament ends happened to fall into physical contact, the results we aden 
worse than useless. Because of an unreliable measure of the ere can 
variable, erratic results that appear to come from a well-controlled stu 
be worse than no results at all because they are so confusing. HER 

Experimental studies are most often analyzed by using statistica ber 0 
niques called analysis of variance. They allow for the control of a veers as 
variables and for the study of the effects of each independent et "i 
well as for interactions between independent variables. Thus, an ap 
menter might find that one specific treatment worked best for one age 8 
but that another treatment worked best for another age group. _ ary He 

Experimental studies in Counseling are quite difficult to desig in 
major reason is that populations of interest are not easy to ce ar a5 
search. Many of the studies on counseling process have been condu jatio™ 
analogue studies requiring the assumption that the available popu nts t0 
often college students, are analogous to clients. Assigning real ae 
specific and sometimes short-term treatment processes is difficult De gelo 
counselors believe that the Proper treatment of clients requires a COUN” of 


to be a diagnostician and prescriber who is free to use the whole ra ex 
treatment modalities unham 


or 

pered by concerns of research design- Fome 
ample, the stud Rogers and Dymond (1954) suggests tne eated 
€n placed in the control group and ie te need 
nto that group because of their immedia 


| tech- 
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for treatment. That decision is consistent with the humanistic goals of coun- 
seling but not with the goal of producing well-controlled experimental re- 


search. 
researchers have turned to the use of videotape and ana- 


ling process. (For example, review any re- 
cent issue of the Journal of Counseling Psychology.) Although this allows for 


tight experimental control, too often the study is so far removed from the 
actual counseling process that it is not clear whether the results generalize to 
nseling outcomes are studied, real clients 


the counseling process. When cou 
are more likely to be used but the process is not often well described so the 
h is limited. 


value for practice or future research 
Thus, while experimental designs allow us to learn more than any other 


type of research, they are also the most difficult kinds of research studies to 
implement. In the counseling field they are extremely challenging but not 
impossible. The study by Stulman and Dawis (1976) reprinted later in this 
chapter is a good example of the application of experimental techniques toa 


Counseling related problem. 


Increasingly, 
logue designs to study the counse 


Historical Research 


erably from the other types of research 
d in counseling, probably because coun- 


seling has a relatively short history. Historical research is an attempt to 
understand some specific aspects of the past. Itis a potentially useful method 
in a field like counseling, where the subject studied—clients and their 
behavior—is very similar to the person doing the study. It is possible that any 
research on human behavior is biased by the human beings doing the re- 
Search in ways that will be apparent only after a number of years have 
Passed, A historical study in counseling should allow us to understand a 
Period of time, its events, and its people, and how they interacted to produce 
What we think of as the counseling literature. Behind each theory proposed, 
each piece of research printed, there is a social, cultural, economic, an 
Political era and there is a person who is unique in his or her needs and 
Interests, Understanding more about how our counseling heritage was pro- 
uced by these forces might help us to understand more about the forces 
that impinge on us as counselors and researchers. 
| learned some new and startling things about how researchers work 
from reading The Double Helix, James Watson’s account of how the struc- 
lure of the DNA molecule was discovered (1968) and the Oppenheimer 
ase (Stern, 1969), which chronicles some of the events surrounding the 


nl research differs consid 
iscussed here. It is rarely conducte 
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development of the first atomic weapons. These books helped me ae a 
how the researcher's values and cultural milieu influence the iesearen I 
cess and ultimately to understand how my values interact with my Ei 
Historical studies in counseling might explore such questions as wk 
is the relationship between warfare and trait and factor theories in nape 
ing (1914-1974)? or “How do the early histories of Albert Ellis, Fritz 
and Carl Rogers differ?” cceniGal 
It is obviously difficult to apply scientific methodology to ern = 
questions. This type of research is open to criticism on the basis of are 
experimental control. Whole books have been written about 
methodology (e.g., Barzun and Graff, 1957; Nevins, 1962). The major i a 
to be made here is that the historical study of counseling has the potentia 
teach us something about what we are doing today. 


READING RESEARCH 
IN COUNSELING 


ing is 

The first thing you need to know about reading research in counseling © 
where to find it. The Journal of Counseling Psychology is one of the atti 
research oriented journals in the counseling area as well as the most atl 
in terms of content. For a reader who is just beginning to explore the coi 
seling literature, itis a good place to start. Other journals that publish : tion 
counseling research, usually in specific areas, include Counselor P 
and Supervision, Elementary School Guidance and Counseling, the ae 
of Educational Research, the Journal of Employment Counseling, the jou the 
of Vocational Behavior, Measurement and Evaluation in Guidance, Ye 
Rehabilitation Counseling Bulletin, and the Vocational Guidance Quana t 
Figure 2-2 suggests a method for reading and evaluating researe™ „| 


ver 
serves as a framework for the following paragraphs, which discuss the S€ 
stages shown in the figure. 


1; Most research articl 


oul 
€s are preceded by an abstract. YOU sh 
be able to tell from 


i icle iS 
: reading the abstract whether an anice 
Interest to you. If not, go on to read another (it is hoped: 


3 ; in 
engaging) abstract. Nobody reads all the research articles 
counseling, 


ore 


ear t0 


. | 
From the introduction the Purpose of the study should be © r the 


er o 
er It Should have some theoretical or practical import ental 
oF 1s Collecting data just for the fun of it. In experim 


i a 
studies, formal hypotheses should be given in addition t° 
general statement of purpose, 
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Either in the introductory section or in the methods section, you 
should be told how each of the important terms and concepts in 
the study will be operationally defined. These definitions should 
be presented early and used consistently throughout the 


manuscript. 


Ii either step 2 or 3 above has been violated, discontinue reading 
unless the topic is of such great interest to you that you are 
willing to put forth great effort to gain a hazy understanding. 
Such studies should not be published, but they are. 


d the methods section to determine whether: 


Rea 
asures used have been 


(a) the reliability and validity of the me 


established and are satisfactory. 
(b) the subjects are appropriate to the study and whether the 


results will generalize to an appropriate counseling situation. 
Is there a large enough number of subjects to draw any 
conclusions? 

(c) the design that was used tests the hypothesis or explores the 
question posed. A common fault at this level is to design a 
study in such a way that it does not answer the questions 
posed. 

(d) the statistical analysis is appropriate to the problem. It is not 
uncommon to find researchers computing a number of 
simple tests that make it difficult to interpret the probability 
of the results, where one complex test would be more 
appropriate and informative. 

(e) the overall logic of the method is sound. This means that you 
don’t have a nagging feeling that the hypotheses have not 
been tested, the sample is too small, or the statistical analysis 
is inappropriate. Any one of these questions should cause 
you to do some checking in the books mentioned throughout 
this chapter or with experts to test out your hunches. 


at all, they will probably lead you to 

d discussion. If you do, you will already be 
or someone else might design and 
Act on these ideas and design your own 
r, who can benefit from your ideas. 


If you have questions 
question the results an 
thinking about how you 
conduct the study better. 
study or write to the autho 


blems with the methods and accept the 


Even if you have no pro 
tyou have ideas about application of the 


results, you may find tha 
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Abstract 


No interest 


Interest 


No purpose or 


Go on to 
hypotheses 


another 


Introduction article 


No operational 
Purpose definitions 
well stated 


Questions about definitions, 
subjects, generalizability, 
design, statistical analysis, 
or overall logic 


Methods 


No major 
obstacles 
to a clear 
interpretation 


Results Other ideas with tha autho? 
REN and/or begin to 
Useful in design a better 
evaluating the study 

hypotheses in fulfilling 
the purposes 


Other 


Discussion interpretations 


| 


FIGURE 2.2 Schematic Diagram for Reading and Evaluating 
Research. 


findings in your setting that differ from those of the author. O" 
you may have ideas for extending the research the author did not 

have. Communicate with the author about them. That’s whet 
caused the interaction in Figure 2-1. A 
Many studies that do not meet all the criteria implied in the u 
suggested above are published. In my own career as a journal editor | hav 
accepted some. Very few studies are perfect and if journal editors wa 
until they came along, not much would be published. On one hand, me 
might be considered a good thing. On the other, it is sometimes useful tO 
publish an imperfect study. | occasionally make the judgment that a 
particular well-designed, nearly perfect study is less valuable than an impe" 
fect one because the nearly perfect one tells us nothing new, while the 
imperfect one introduces fresh new ideas that will generate considera? _ 
a kung and research. In such cases | usually ask the authors tO as 
wledge and discuss the limitations of their work. 


is 
The reader of research should be aware that imperfect research 
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published and be prepared to read critically. The general editorial review 
Process that most research goes through before it appears in journals is 
usually designed to insure merit but not perfection. 


AN EXAMPLE. A study by Stulman and Dawis is reprinted here because it 
represents a good, well-written, and creative experimental study. However, 
parallel to it is an example of how it could have been written less well and 
what a journal editor might say about the “parody.” The original article 
appears in roman type, the parody in bold face type, and a running critique 
of the parody alongside it in italics. 


Experimental Validation of Two MIQ Scales* 


David A. Stulman and René V. Dawis 
University of Minnesota 


: Two Minnesota Importance Questionnaire (MIQ) scales, Creativity and Inde- 
pendence, were validated by experiment. Subjects were exposed to four task condi- 
f high or low levels of Creativity and Inde- 


tions representing joint combinations of 

Pendence. As a behavioral criterion of preference, subjects were then required to 
Work for 12 sessions, each session under any (of the four) task conditions of their 
choice, The behavioral results were consistent with the subjects’ MIQ score levels on 


th Ir 
he two scales, thereby validating the scales. 


Comments by a Prototypic Reviewer 


Experimental Validation of Two 
Regarding "A Parody... 


Scales: A Parody for Pedagogical 
Purposes 


ip ac Lenore W. Harmon 
niversity of Wisconsin - Milwaukee 


ABSTRACT 
Yesil e inventory scales were in- 
cedure ed by an experimental pro- 
conditi that exposed subjects to four 
c Whee ar en. required them 10 Why was this done? 
Sults ons them. Significant r Not enough information to help the 
Were obtained. reader decide whether to read further. 


What inventory? 
What scales? 
What conditions? 


have been exhorted to “reconcile” the “two 
’ (Bindra & Scheier, 1954; Coffield, 1970; Cron- 
1968). Simply put, the “experi mentalists’’ have 
differences in their experiments and theories, 
admonished to utilize theory and experiment 


disci the years psychologists 
Dach T of scientific psychology 
been y 57; Dashiell, 1939; Owens, 
While a to consider individual 

he “‘correlationists” have been 
om D.A; Stulman and R. V. Dawis, Experimental validation of two MIQ scales. Journal of 
me al Behavior 1976 a 161-67: Reprinted by permission of the publisher, Academic 


Tess, Inc.) 
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nth T at 
e e e prese yisa attempt a 

in the investigation of their “applied” problems. he present soy See ascent? 

tilizing experiment in what is ordinarily a correlational problem: a 

uti X i onota 

psychometric instrument. 


i that 
Inventories are usually validated The author seems ir imply PE aa 
by correlating scores with some correlational validations lac 
criteria. The purpose of this study Why? What? 
was to use an experimental design to 
accomplish that purpose. 


m , e 4 awis, & 

The Minnesota Importance Questionnaire (MIQ; Gay, Weiss, | enal, oe to 
Lofquist, 1971) is a 20-scale, paired-comparison self-report instrume Utilizing scal- 
measure vocationally relevant needs, i.e., preferences for reinforc ers; Case V of the 
ing methods developed under the assumptions of Thurstone’s laste culated o 
Law of Comparative Judgment (Guilford, 1954), MIQ scale values i > respondent: 
reflect the relative importance of 20 work or vocational reinforcers to the pai from the 
The scale values are anchored to a “zero point” (separating the ne a ali 
“not important” reinforcers), thereby enabling comparison across ur miles 
idea of the MIQ’s content domain can be gleaned from the nn Authority; 
Ability Utilization, (b) Achievement, (c) Activity, (d) Advancement, a cone 
Company Policies and Practices, (g) Compensation, (h) Co-workers, A seci 
Independence, (k) Moral Values, (l) Recognition, (m) Responsibility, ' Supervision 
Social Service, (p) Social Status, (q) Supervision-Human Relations, (r) $ 
Technical, (s) Variety, and (t) Working Conditions. idity of the M Q 

As in the case of many other psychometric instruments, the valid ity (i.e., nom 
has been based on evidence from correlational and “natural varaion. yrediction 
manipulated) studies, such as studies of group differences and concurre re prefer” 
(Gay etal., 1971, pp. 46-55). It occurred to the authors that scales measl seriment 
ences might be amenable to validation in a laboratory setting, with exp 
conditions bein 


055!” 
; . i : ight be p 
8 manipulated as in conventional experimentation. It mig 

ble, for example, to expose sub 


> ask MIS 
jects to varying conditions under which a te 
be performed and 
Such “experimental” 


n 
a) 
(À 
(j) 
o) 


‘erred 
then to determine which of the conditions was most pre ore 
preference could then be used to validate the preferen 
generated by the MIQ. 
Two MIQ scales a 


Creativity (“I could try 
work alone on the job’’ 


i tion 
n P e nenta 
ppeared to be most promising for such experin 


Id 
nį cour 
Out some of my own ideas”) and Independence ("I ji. 


ivi contrasting CT at 
). The Creativity statement suggests two 


N 
-tateme 

i Fact om e state! 
tions: one, permissive, and the other, prescriptive. The Inland on others, 
suggests the two contrasting conditions of working alone and working th 

Since the twi 


s5 
o scales correlate very little 


xt cro . 
(r = .26), it would be possible to alone 


two sets of conditions, yielding four conditions: permissive and working 
Permissive and working with other 


re 
5; prescriptive and working alone; and P . 

tive and working with others. criterion 
After exposing subjects to the four conditions (in random sequence), a ork for r 

of behavioral prefe mined by requiring each subject to W de! 
given number of sessi i j 
which of the four 
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The inventory chosen for study 
was the Minnesota Importance 
Questionnaire (MIQ) which meas- 
ures needs (Gay, Weiss, Hendel, 
Dawis, and Lofquist, 1971). Within 
the MIQ, two scales, Creativity and 
Independence, were selected. They 
are not highly correlated so it was 
Possible to cross the two sets of 
conditions to create four sets of 
conditions. 


Not enough information is given about 
the MIQ-Does it have any established 
reliability or validity? What is it designed 
to measure? How were these scales de- 
veloped? 


How much are they correlated? I would 
rather know the correlation than the 
author's evaluation of it. 


METHOD 


Subjects. 


Low Creativity-High Independence, 
and Low levels represented approxim 


of the original group’s distributions of Independence i 
vels were 1.3 for Creativity and .1 for Independence. 


Minimum scores of High le 


Maximum scores for Low levels were .8 for 


METHOD 
Subjects. From 284 volunteers, 68 
Subjects were chosen because they 
gaa be classified on the basis of 
heir MIQ scores into one of the four 
groups needed for study. Some of 
ig remaining volunteers were used 
de Members: OF the Low Indepen- 
nce groups. 


Procedure, 


Condition. No model was prescrib 


Could design his/her own Tinker Toy figure. W 


dence condition; working with two other persons of th 
n. (The “two others 


ainder of the original group of 284) 
nder each of the four task conditions: (a) 
king alone without a model); (b) High 


= the Low Independence conditio 
Ondition were drawn from the rem 


_ Each subject had to work for 7 min u 
igh Creativity-High Independence (worl 
Galvily Low Independence (working in a 
eativity-High Independence (working alone w 
and (d) Low Creativity-Low Independence (wor! 
ditions was randomize 


Exposed to all four conditions, the subject was requirec 
een. For each 4-min session, the subject chose 


Ti i > 
eplicate). The sequence of con 


S ` pi 
ions, with 1-min rest periods in-betw 


© condition under which he/she preferred to worl 


l Subjects were 68 college stude 
an Introductory psychology course at a sta 
subjects were chosen from an original group 
be classified on the basis of their MIQ scores ( 


categories: High Creativity-High Independence, 
and Low Creativity-Low Independence. High 


ately the upper and lower thirds, respectively, 


Ti The work task each subject h 
inker Toy elements. A model to be replica 


nts, 40 females and 28 males, enrolled in 


te university in the fall of 1973. The 68 
of 284 volunteers because they could 
adjusted scale values) into one of four 
High Creativity-Low Independence, 


and Creativity scale scores. 


Creativity and —.6 for Independence. 


Not enough information is given about 
the subjects and how they were selected. 
It would be hard to replicate this study or 


to generalize from it. 


The four groups needed have not been 
clearly explained. Thus, the status of the 
remaining volunteers is still unclear. 


ad to perform was the assembly of a set of 
ted was prescribed for the Low Creativity 
ed for the High Creativity condition; the subject 


orking alone was the High Indepen- 
f the same sex as the subject's 
' for the Low Independence 


group without a model); (c) Low 
ith a prescribed model to replicate); 
king in a group with a model to 
d for each subject. After being 
ed to work for 12 4-min ses- 


k. Thus, the number of sessions 
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iti i ji f ference for the 
spent on each task condition was a direct behavioral measure of preferer 


task condition. 


Procedure. Each subject was 
given a work task—assembling ele- 
ments of a set of toys. In the Low 
Creativity condition a model was 
given but in the High Creativity con- 
dition the subject could assemble 
the elements in any way he/she de- 
sired. 

Each subject first worked under 
each task condition for a specified 
period of time. Then the subject was 
required to work for 12 sessions but 
he/she could choose which one of 
the four conditions he/she preferred 
for each task served as a measure of 
preference for each task condition. 


Was the form the elements “should 
take implied by the elements? Were hey 
parts of a train for instance? Or noaa 
Logs? If so, the presence of a act 
not as important as spatial and mec p 
cal ability in the case of the train, an 
prior experience in the case of Linco 
Logs. 


Do we have two or four task conditions 
here? How long were these se 
Could fatigue have been a factor? Or: 
quencing? 


RESULTS 


Table 1 shows the means and stand 
spent by the various groups in each of t 


grouped by sex and MIQ score p 
and Independence, “high” 
Regardless of group, the hi 
generally observed for the High Cre 
lowest means generally obt 
tion. Considering each task 
the group with the 
exception is th 
males, the Higt 


RESULTS 
Table 1 shows the time spent in 
each condition by each group. It is 
clear that the appropriate groups 
Scored high on the appropriate task. 


A multivariate anal 
puter program UMST 57 


attern (i.e., those scoring “high” on both Cre es). 
on one and “low” on the other, or “low” on both m 3 
ghest means (i.e., the longest amount of time pein 
ativity-High Independence condition, whi sail 
ained for the Low Creativity-Low Independence Be for 
condition separately, the highest mean is observe 


s 6 only 
appropriate MIQ score pattern, with one exception. Ihe 7 
at under the High Creativity- 


h Creativity-High Independen 


ing: c f sessions 
ard deviations for the number E hei are 
he four task conditions. The subjects ¢ 


ativily 


are 
the 


r 
ai ition fO 
Low Independence task conditi 
ce group had the highest mean. 


5 
l read Table 1 to show that within gon 
the highest scores were for the 40 gh 
priate condition except in hA gin 
Creativity-Low Independence eativ- 
However, most groups like high cr& the 
ity a lot. Which brings us back t0 


s 5 © cal 
question of where these subject 
from. 


weigh- 
$ capable of handling unequal cell frequencies. An un id 


j ! -< would 
was used because the sums of squares in such an analysis f 
be conceptually m ful. If 


f . 5 o 
eighted means analysis were used, $ í 
removed when interaction effects ¢ 


me Q 
re te 


"waned Ow dnos3 ayı oy Suipuodsaso> uo 


UOD JSL} BU} JO} paossa pun oie sueaWw q 
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moved, thereby confusing the interpretation of main effects.) The nn 
dent variables in this case consisted of three variates, number of nn 
respectively, in the High Creativity-High Independence, nn en ers 
pendence, and Low Creativity-High Independence task conditions. ( Nur vate 
sions spent in the Low Creativity-Low Independence condition was sompen k 
termined by the number of sessions spent in the other three task gonoin e 
therefore was not free to vary.) The independent variables in this analysis wer 


; sai alysis 
Creativity and Independence levels and sex. The results of the multivariate analy 
of variance are summarized in Table 2. 


TABLE 2 ENTIN 
MULTIVARIATE ANALYSIS OF VARIANCE FOR NUMBER OF SESSIONS SP 


EACH OF FOUR TASK CONDITIONS 


Effect F ratio (3,58) p value 
Creativity 2.74 05 
Independence 4.25 01 
Creativity x Independence 0.78 51 
Sex 1.07 37 
Creativity x Sex 1.25 -30 
Independence x Sex 1.33 27 
Creativity x Independence x Sex 1.37 26 ___- 


ce 
oe nden 
As Table 2 shows, only the effects due to MIQ Creativity and em ii 
scores were statistically signiticant. Sex was nota signiticant source ot varia 

were the various interactions significant sources of variation. 


Table 2 shows that only the ef- 
fects due to Creativity and indepen- 


dence were Significant in a mul- 
tivariate analysis. 


. a 
Why and how was this analysis don 


Subsequent! 


for 
each task conditi 


Hig? 
pendence groups) and between f 


results are suggestive of 
analyses. 


_Table 3 shows that the High Creativi w 
sessions) than the Low Creativity group in the High Creativity task conditions, on 
the Low Creativity group spent relatively more time in the Low Creativity task a to 
tion. However, the High Creativity-High Independence task condition appeal” ad 


. af 
= behaviorally preferred about equally by both High and Low Creativity group oth 
the Low Creativity-High Independence was unattractive almost equally t° 


tendencies.) Table 


f 
i ene 
ty group spent more time (numb hile 
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groups. The High Creativity group behaviorally preferred the High Creativity-Low 
Independence condition significantly more than the Low Creativity group, which in 
turn preferred the Low Creativity-Low Independence condition significantly more 
than the High Creativity group. 

An analogous but more prono 
and Low Independence groups, with th 
four task conditions. As Table 3 shows, t 
preferred the High Independence task con 
Independence group, while the latter preferred the Low 
relatively more than did the High Independence group. 


unced pattern of results is observed for the High 
e findings being significant for three of the 
he High Independence group behaviorally 
dition relatively more than did the Low 
Independence task condition 


TABLE 3 
MEAN AND STANDARD DEVIATION OF NUMBER OF SESSIONS SPENT IN EACH 
OF FOUR TASK CONDITIONS, BY MIQ GROUP 


= MIQ Creativity Group 
High Creativity Low Creativity patio 


Task condition M SD M SD (1,64) p value 
High Creativity-High independence 534. 248 5.21 2.95 0.003 84 
High Creativity-Low Independence 4.23 2.93 2.96 2.42 3.92 .05 
Low Creativity-High Independence 1.42 1.54 1.97 2.20 1.46 23 

1.00 1,32 1.86 1.47 6.66 .01 


Low Creativity-Low Independence 
MIQ Independence Group 


High Low 
Independence Independence 
M SD M SD 
283 458 2.35 460 .04 


High Creativi i 5.97 

k ativity-High Independence 3.974 

High Creativity-Low Independence 295 2.88 4.25 = 5 
pre Creativity-High Independence 2.04 a3 = ke pee Pr 
OW Creativity-Low Independence 1.04 1.12 1.82 . . .02 
Note: 7 

t Mep aximum score = 12. tions corresponding to the MIQ score-level group. 


leans are underscored for the task condi 


I couldn’t tell what was done here with- 


Table 3 sh that significant Í du 
di shows t looking at Table 3. The problem is 
ow anaoa between the High At that the groups contrasted are not clearly 


TS reativi d the 
vity Groups an t 
Leativity Groups and the High and delineated. 
tr R Independence Groups resulte 
Univariate F tests. 
CONCLUSION ES 
The experiment described above has shown that ae WOD 
au eat ity and | expressed in a paire -comp ‚se 
fs ivity and Independence, a5 or ln 


e : : 
Stionnaire, are consistent with preferences p 
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expressed through behavioral choice. The experimental results a saput 
the validity of the Creativity and Independence scales of the le a a fee A 
preferences for the corresponding reinforcers, i.e., as measures of : en sen 
The study is, of course, not without its limitations, Only two of the 2 le 
were validated; only two levels were used for each factor (scale); on Y stained 
students served as experimental subjects. Different results might have nn a n 
with more (or other) scales, more levels, or a different population. Furt de in ER 
the present study, while within a given task condition the most ae is en he 
appropriate group in the appropriate task condition, across tas ae te alt 
behavioral preference is decidedly for the High Creativity-High Indepenc Speci) 
tion (a finding which might be related to the use of college students as en) 
Nonetheless, the study does show that experimentation can be utilized amy ae 
in what has long been a private preserve of correlational methodology, the valide 

of a psychometric instrument. 


CONCLUSION 


mn freely 
This study showed that sub- The author generalizes far too freely 


jects chose tasks consistent with 
their scores on two MIQ scales, 
Creativity and Independence, thus 
validating these scales. It seems 
reasonable to expect that other MIQ 
scales could also be validated in a 
similar fashion. Although college 
students were used as subjects here 
(with an attendant preponderance of 
preferences for creativity and inde- 
Pendence) it seems safe to assume 
that even more Pronounced trends 
would be evident with a more gen- 
eral population. 
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supervision of the second author. The study w. 
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from the data. 


The relationship of the sample ites 
high level of preference for lig 
and independence should have ie 
discussed earlier, not just hinted at here. 


Overall, this may be a good study m 
this report of it does not deal with ne 
of the major pieces of informa d 
needed to determine whether it is or NO" 
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CHAPTER 3 
Research for Action: 
The Tradition and 
Its Implementation 


Ena Vazquez Nuttall and Allen E. Ivey 


5? Couldn't the money be spent somewhere 
anning workshop really make a differ- 
and guidance programs, really? 
to the demonstrated needs and 


Maw do you justify your service 
se more effectively? Did the life-pl 
ence? How effective are your counseling 


Are your activities and programs responsive 
wants of the people you serve? Do we as professional helpers really ‘make a 


difference”? Counselors need to prove their worth and improve their wares. 

. How can counselors meet all these challenges? They are often ill- 
equipped to provide systematic assessments of their services and programs. 
Perhaps equally troublesome is the fact that counselors are often unac- 
ge with the basic research in their field. They desperately need more 
the mation and new skills in order to begin to carefully construct answers to 

many difficult questions that lie ahead. 
ieee chapter demonstrates how counselors c 

Ore fully in the assessment of needs and services an 
with the publics they serve. Specifically, this chapter seeks to: 
f action research, both as background for 
h methods described in the chapters of 
ly well suited to the 


an involve themselves 
d communicate better 


1. Present the tradition © 
all the applied researc 
Section 3, and as a point of view eminent 
practical research needs of counselors. 

esearch for action can be implemented so 


2. Explain in detail how r 
initiate and complete their own projects. 


that practitioners can 
fusion and implementation of research 
counselors make effective use of the 


79 


3. Discuss the process of dif 
findings in order to help 
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research findings produced by others and to set up their own 
research projects so that the results can be put into practice and 
made known to others. 


THE TRADITION 
OF ACTION RESEARCH 


Kurt Lewin stated it succinctly: “No research without action, no action 
without research.” Action research provides a systematic framework in 
nselor, therapist, or other professional in the help- 
and determine the effectiveness of his or her 
es a model for the evaluation of the effective- 
€ program, or a totality of guidance services. 
research dates back to the late 1930s and the 
gist named Kurt Lewin in this country. Lewin, 
ed by Nazism, the Depression, and World Wat 
ople and groups behaved as they did and what 
heir behavior. He was a scientist concerned not 
its to be derived from social action, but also that 
ms be done in ways that would at the same = 
ation of knowledge. During his brilliant in 
ed set up many different institutions such as th 
roup Dynamics at MIT, the Commission on Com 
nd the National Training Laboratories (Niaren 
ects combined action with research. In a documen 
ommunity Interrelations (Marrow, 1969) three dis- 
ics of action research were outlined. First, “it swt 
ith people who wanted practical answers; second, : 
nder community rather than laboratory condition 
Nt of attitudes and behavior would be made both 

ction step to discover which methods succeeded an 
which failed.” (p. 7) 


1969). Most of these proj 


ntary form, action research may be described s 
ned change and the observation of its or is 
r j esearch involves: (1) the explicit statement of ae 
experimental Intervention (this may be a specific counseling intervention ©. 


t 
it may be as general as a total Counseling services program); (2) the a 
Statement of the goals of the i 


whether or not 


ine 
al, group, or Program inter i d determ! 
, ventions an 
whether or not stated goals were achieved, However, complex experimenta 
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designs are also possible within the broad-based conceptual frame that is 
action research. 

: In contrast to basic research, action research builds diffusion of find- 
ings and their implementation directly into the research design. Research 
that does not lead directly to future action is considered irrelevant. In short, 
action research is always for a purpose: to check whether or not a helper 
Intervention has benefited a client, to examine whether or not a specific new 
Program made a difference in the lives of participants, to evaluate the effec- 
tiveness of an organized set of helping services. Then, having determined 
the effectiveness of the intervention or program, the helper is prepared to 
take additional steps as a result of feedback from the evaluation. 

ú As Kurt Lewin stated, action research appeals to mission-oriented prac- 
itioners: 


If we speak of research, we mean “action research,” that is, action on a realistic 
level, action that is always followed by self-critical objective reconnaissance 
and evaluation of results. Since we like to learn rapidly, we will never be afraid 
to face our shortcomings. We aim at “no action without research; no research 


without action.” (quoted in Marrow, 1969, p. 193) 


Four Varieties of Action Research 


and Harding (1948) concentrated 


Among the Lewinian group Chein, Cook, € 
and the problems inherent 


On spelling out different types of action research ] ] en 
!N each. They outlined four varieties of action research: diagnostic, partici- 


Pant, empirical, and experimental. The following pages contain a discussion 
of each of these four types of action research, an outline of the steps in- 
Volved in performing each type, and brief examples illustrating how to 
accomplish each step. After that, we present an extended illustration of the 
*PPlication of the four steps in a counselor training method. ; 
The diagnostic research paradigm represents perhaps the most typical 
and simple problem-solving strategy of the helper faced with problems and 
Crises On the job. Diagnostic action research consists of: (1) the emergence 
a problem, (2) a diagnosis of its causes, (3) formulation of all the possible 
Venues of remediation, and (4) recommendations for a possible solution. 
‚An example of the diagnostic action research approach ina counseling 
Setting is the frequent problem that emerges during the summer months with 
Cenagers roaming the streets, creating problems to the community. 
1. This usually becomes known officially after several teenagers are 
arrested by the police. Let us suppose that you are a counselor working in a 
©MMunity mental health center and the mayor of the town asks for your 
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help in the solution of this problem. Now the problem has,emerged and you 
are in charge of finding a solution. . 

2. Your next step is to obtain a clear idea of what the causes of the 
problem are. In order to do this you should identify and talk to all the 
important actors taking part in the drama. Talking to the teenagers arrested 
and other teenagers in the community to find out what they think is causing 
the problem will add clarity to the scenario. Interviewing police officers, 
parents, school personnel, business owners, recreation personnel, and other 
community members about their perceptions of the causes and possible 
remedies to the problem would further enlighten the picture, 

3. After obtaining an accurate assessment of the situation from the 
interviews with all the relevant actors, the counselor formulates a series ol 
possible solutions to the problem. In this case it may be that the difficulties 
experienced by the teenagers were due to lack of meaningful activities 
appropriate to their age. The counselor then brainstorms all the possible 
solutions, among them: making available more summer jobs for teenagers, 
providing more educational Opportunities, creating more leisure time ac 
tivities, hiring a streetworker to help the teenagers, approaching the 
churches to offer programs for teenagers, and contacting the parents of the 
teenagers involved to see if they can offer their own solutions. . 

4. After studying the different possible solutions, the counselor makes 
a final set of recommendations. If the recommendations are accepted an 
followed by the appropriate agencies, the diagnostic action research project 
can be considered a success. However, if the recommendations are not 
followed, the project is judged a failure because this model conceives of the 
Process as a whole unit involving diagnosis, research, and attempts at re- 
mediation. 

Another example of the use of the diagnostic action research approach 
is the hypothetical case of a director of a college counseling service who !° 
asked to analyze the problem of and possible solutions to the large number 
of transfers from and high vacancy rates of the tallest dormitory on campu”, 
a forty story high-rise building. (1) The problem thus is the lack of popularity 
of this particular dormitory. (2) The second step is to investigate the reasoN® 
why the students do not like to live in that dormitory. To accomplish this 
goal, the director interviews the administrative staff of the dormitory, the 
students living in it, those who transferred out, and many other relevant 
Parties. (3) After this information is gathered and there is a clear idea about 
what is causing the problem, the director formulates a series of possible 
solutions. Among the solutions could be to fire or transfer the administrative 
staff of the dormitory, to change the system of roommate allocation, t° 
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replace the food services director, increase the services and facilities availa- 
ble in the building, or change the use of the building. (4) From this set of 
recommendations the director chooses those that seem more feasible and 
appropriate to the specific circumstances. 

Another variety of action research is participant action research. This 
approach seeks to remedy some of the pitfalls of the first approach namely 
that recommendations are not always implemented and that the failure to 
ee them is mostly due to lack of involvement of the relevant publics 
en the very beginning of the project. The most distinctive characteristic of 

type of action research is the involvement of the people who will later 
Participate in whatever action is recommended. 

The steps to follow in the participant action research model are as 
follows: (1) observing the emergence of a problem, (2) involving all impor- 
tant parties relevant to the causes and remediation of the problem, (3) brain- 
storm ing all the possible causes of the difficulty with participating members, 
e defining the problem and determining whether further data are needed 
CS intervening, (5) designing an interview or questionnaire to obtain 

er data, (6) training community participants to administer the instru- 
ment, (7) analyzing the data, (8) making final recommendations, and (9) 


nvolving the participants and others in carrying out the recommendations. 


An example of this approach takes place in a community being 
plagued by excessive vandalism of its schools and businesses. The school 
Fi and the chamber of commerce ask the director of the mental 
health center to help the town find a solution to the problem. 

id A The problem is: What are the causes of this increase in vandalism 

hat possible solutions are there? 
thes ores director of the mental health 
an ho have some involvement with t 
some of the causes or because they 


soluti 5 heat 
ren of the problem. Among those invited 
ners of the businesses affected, members of the schools’ PTA’s, police 


Pr oe staff, members of the school guidance and counseling services, 
Icers of youth organizations, organizers of church youth programs, mem- 
ers of adolescent self-help groups, staffs of adolescent mental health ser- 


vi 

Ces groups, and many others. 
the 3. Once the group is contacte 
the possible causes of the problem, the possi 


It 
Y of resources is organized and conducted. 
4. The group may decide after deliberations that the problem is not 


tota s x : 
tally clear and that it needs more information. It decides to survey all the 


center immediately contacts all 
he problem either because they 
are likely participants in the 
are principals of the schools, 


d, a brainstorming session concerning all 
ble remedies, and the availabil- 
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school principals and business owners to ask them about the N 
vandalism, hours and days at which it occurs, possible culprits, and poss 
a, interview is then designed to obtain the relevant information and 
community people are trained to conduct the interview. a sits 

6. Once the data are obtained, they are analyzed using the anp je 
statistics. The data are then prepared for presentation using simple tables 
and easy-to-follow graphic materials. 2 NE 

7. The new information is then presented to the group of participan : 
in order to determine possible solutions to the problem in light of the nev 
data gathered. re 

8. The group narrows down the recommendations to those that a 
more feasible and cost effective. 

9. By virtue of their involv 
the participants that have positi 
recommendations will now 
appropriate action. 

Empirical action research involves using 
and keeping accurate records of wh 
analogous to the clinic. 


: ; A inning, 
ement with the project from the beginn he 
Ons in agencies that are to implement nr 
take over and help to initiate and perform 


a certain type of intervenlien 
at is done and what happens. It! 
al wisdom developed by a physician who keeps ore 
of illnesses, the remedies prescribed, and the results obtained trom ihe 
different interventions. The specific steps involved are: (1) performing n 

intervention, (2) keeping a record of the activities the helper engages In 3 & 
the clients’ reactions to these activities, (3) assessing the effects of the 4 


tivities on the clients, and making changes in the interventions according 
the results. 


Examples of this type of action rese ining 
work of counselors. For instance, a counselor running assertiveness train (1) 
groups who wants to use the empirical action research model begins by ol 
deciding to perform a particular type of intervention, in this case a a he 
about 15 women that meets once a week for sixteen weeks. (2) Next, © 


é h 
Counselor keeps an accurate record of everything she does during eaC 
the sessions of the sixteen week j 


records the clients’ reactions to a 
the intervention. For exa 
playing than to small g 


` in the 
arch occur very frequently IN 


sa the 
Using the results obtained from evaluating 


real 
n, the counselor may decide not to repeat the t 
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ment, to change certain parts of it, or, if the results of the analyses have been 
positive, to repeat the treatment in the same fashion. 

The fourth kind of action research is experimental action research. 
Experimental action research is the brand of action research that comes 
closest to what is generally regarded as the ideal research paradigm 
—experimental control group design. However, the experiment is carried 
out in the field, not in the laboratory. Another difference is that the object of 
experimental action research is to solve practical problems, while in the 
classical experimental design the experiment does not necessarily need to 


have practical relevance. 
esearch might be used when the counselor wants 


. Experimental action r 
to find out the relative effectiveness of two or more methods of intervention 


Or action. This type of action research requires taking pre and post measures 
of the variables that are supposed to change with the intervention. Usually 
the design also includes the use of a comparison or control group. 
Sometimes experimental action research will be used when the coun- 
selor is examining the effectiveness of a single intervention. Here the design 
would use pre and post measures of the relevant variables and may use 
several measures over time to examine the effects of the intervention at 
Several periods of time. The research questions would be: Does the interven- 
tion accomplish the goals it was supposed to accomplish? Is this type of 


Intervention useful? 

Among the four types of 
Most to offer for the advancement of know 
research has been well executed, the study can give m 
to the theoretical questions. 

d This type of design invo 

etermine the relative effectiven 
a the hypothesis to be investig 
hypothesis, (4) selection of appropriate | 
Post measures, (6) analysis of the data, (7 
More interventions is better or whether a pa 
and then changing the practice accordingly. 

To better understand the steps of the experimental action research 
Paradigm, let us suppose that you are a counselor in a mental health setting 
and that you have been given the job of training a group of paraprofessionals 


to work as counselors. (1) You would like to find out which of two different 


training methods will do the job most effectively. Which of two training 


oe will create the best counselors? (2) You decide to use two very 
a training styles: one a systematic step-by-step approach and the 
er an intuitive, creative, spontaneous approach. Based on careful 


action research, the experimental type has the 
ledge. If the experimental action 
ore definite answers 


Ives the following steps: (1) the decision to 
ess of an intervention, (2) explicit statement 
ated, (3) a research design that tests the 
measures, (5) obtainment of pre and 
) a decision about which of two or 
rticular intervention is effective, 
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analysis of pertinent theories, you hypothesize that the systematic zane 
will produce more effective counselors than the intuitive ge aor 
(3) Your research plan is to train two groups of paraprofessionals, each 2 
a different method. Measures of counseling competence will be taken bei ji 

and after the training. People are assigned to the two training ap es 
random or other acceptable methods to avoid any sampling bias. (4) El 
question of finding a measure of counseling competence that is relia is 
valid, and well-researched is a difficult one. Choose one that best fits 
Project. (5) Administer the measures of counseling competence before > 
after the training to both groups. (6) Analyze the data. (7) If the data u 
that those persons trained with the systematic step-by-step approach ” 

better counselors than those trained through the more informal approach, 


A 4 we P £ PR n ara- 
you will have reliable information on which to make decisions about pa 
Professional training in the future. 


Summary of the Four Varieties of Action Research 


The four varieties of action research—diagnostic, participant, empirica ar 
experimental—represent a Continuum ranging from somewhat crude, nos 
nongeneralizable research to more sophisticated, representative niet 
generalizable to other populations. Experimental action research ‘sine 
the highest degree of research sophistication and diagnostic the lowes ach 

Diagnostic and Participant action research are very similar to io 
other. The main difference between the two is that the participant Ense 
research model includes in the planning and conduct of the SER as. 
people who will be involved in the application of the study’s fin « of 
Participant action research is an improvement over diagnostic bacan Br 
the built-in diffusion measures. However, Participant action research ee 
S in its implementation because the researcher 


* i rl pe 
science as much as its experimental cuma 
arch model deals with the same types of pro 
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Instruments. The empirical action research approach is really a sophisticated 
common sense approach to the problems of day-to-day practice. Experimen- 
tal action research attempts to satisfy as many of the classical experimental 
design features as it can in the real world. 

All these four types differ from the classic experimental model in that 
they are oriented toward obtaining results relevant to practice and are con- 
ducted in the real world instead of in the artificial conditions of the laboratory. 


Microcounseling: Action Research in Action 


Microcounseling (Ivey, 1971) is a videobased counselor training program 
that systematically studies the helping process. The original work for micro- 
Counseling was completed in 1966 and first published in 1968 (Ivey, 
Normington, Miller, Morrill, and Haase). Microcounseling has since be- 
Come one of the more widely used counselor and paraprofessional training 
Methods in the United States and Canada. It began with an action research 
Problem: How can one define the specific dimensions of the helping pro- 
cess and how can these dimensions be most effectively taught? Out of this 
highly action-oriented question has arisen an array of highly clinical, 


action-research, and experimental studies. The purpose of this section is to 
examine microcounseling as a specific example of action research con- 


ducted by a team over a period of several years. 


MICROCOUNSELING DEFINED. First, it is necessary to define precisely 
What microcounseling is and the goals of this orientation to helper training. 

icrocounseling is a scaled-down sample of counseling in which the coun- 
selor, therapist, or lay trainee talks with volunteer clients during brief five 
Minute sessions that are videorecorded. Rather than teach helping ‘‘all-at- 
Once” as done in traditional training programs, microcounseling focuses on 
Specific single skills. Thus, through a highly systematized form, trainees 
aspects of the total helping process. 
nicrocounseling, however, is the recent dis- 
Covery that the skills of helping need not be restricted to professional and 
Paraprofessional helpers—they can be taught systematically to the general 
ay Public. Parents (Bizer, 1972), junior high school students (Aldrige, 1971), 
and elementary school children (Goshko, 1973) have all demonstrated their 
ability to learn and profit from the microcounseling framework and its adap- 
tations, Extensions have also been made into systematic work with psychiat- 
"IC patients (Donk, 1972; Ivey, 1971, 1973) that suggest a teaching approach 
Or behavior change is a valuable therapeutic alternative. 


Wickly learn important 
The most vital fact about n 
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The standard paradigm for microcounseling training consists of the 
following steps (Ivey, 1974, p. 6). 


ls Videotaping of a five minute segment of therapy ee 
or, if itis a couple or a family, five minutes of interaction aroun 
a selected topic. 


2. Training. First a written manual describing the single skill being 
taught is presented to the trainee(s). Next, video models of T 
“expert” therapist or “good” communication illustrating the ski 
are shown, thus giving trainees a gauge against which to ; 
examine the quality of their own behavior, Trainees then Al 
their own videotapes and compare their performance on the ski 
in question with the written manual and video model. Seeing 
Oneself as others see you has a particular impact. Finally, a 
trainer-supervisor provides didactic instruction and emotiona 
support for the trainees. 


3} Videotaping of a second five to ten minute session. 
R 5 x A e ire 
4. Examination of the last session and/or recycling of the enir z 
procedure as in step 2, depending on the acquired skill leve 
the trainee. 


The time period for the training is approximately one hour and a recych 
ing to step 2 adds another 30 to 45 minutes. The procedures of microco 
seling involve cue discrimination, modeling procedures, and operant re er 
forcement by the trainer of newly learned behavior (typically, the train 
ignores ineffective behavior and rewards positive behavior change). 


THE FIRST STAGE—DIAGNOSTIC ACTION RESEARCH. The first re 
encountered by the research team attempting to define the single skills © tha 
helping process was to diagnose that very helping process. What is It 
can be recognized as effective helping? What are behaviors that ca” 
clearly identified and measured? 

_ Diagnosing the helping interview involved reading books on hel 
sessions by a variety of authors and inviting in a panel of experts to give a 
views. Although these efforts were helpful, it was finally found that ae e 
videotaping of the helping session itself and diagnosing specific compo” 
Portions of the interview was basic. ing 


The first set of specific behaviors diagnosed was termed “attend 


ping 
their 
ect 
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behavior” and included dimensions of eye contact, body language, and 
verbal following behavior. Through direct observation and diagnosis of vid- 
eotapes it was found that ineffective helpers tended to break eye contact 
frequently, have distracting body communication, and topic jump fre- 
quently. 

Subsequent to this identification process, three action research studies 
were designed to test the effectiveness and reality of the diagnosed con- 
structs (Ivey, Normington, Miller, Morrill, and Haase, 1968). The first study 
involved a simple pretest posttest comparison of beginning helpers-in- 
training. Thirty-eight trainees were divided into an experimental and a con- 
trol group. Videotapes with specific behavioral ratings of eye contact, body 
language, and topic jumps were made before training and compared with 
Videotapes made after microcounseling training in the specific skills. The 
target of this study was to demonstrate that the constructs diagnosed could 
be identified and measured and that training could improve behavior of 
beginning helpers. Results on this first study were positive. Specifically, the 
action goals were attained. } ; 

Two subsequent studies in this same series examined the counseling 
skills of reflection of feeling and summarization of feeling, two helping 
Constructs considered important in active listening. The design used in these 
Studies employed a simple pretest—training—posttest design and no control 
groups were used. The focus in these studies was to demonstrate that the 
80al of changed behavior in the interview was achieved. Each study used 


small groups (N’s of 11 and 10 respectively) because action research is often 
done with small groups who seek to change specific behaviors or action. 


Once again, the action goals of changed helper behavior were achieved ina 


short time, 

These first studies have been followed by an array of diagnostic re- 
search into the nature of the helping interview. Skills of questioning , para- 
Phrasing, minimal encouragements, directions, self-disclosure, interpreta- 
tion, and others have been diagnosed and assessed in the microcounseling 
Paradigm (cf. Moreland, Ivey, and Phillips, 1973; Sherrard, 1973; Authier 
and Gustafson, 1975; Chadbourne, 1975; and a complete review of the 
Microcounseling literature in Kasdorf, in press). ; 

The significance of the diagnostic phase of microcounseling research 


On the practicing counselor may be described as follows: 


it Any counselor who wishes to diagnose his or her own behavior, 
the behavior of paraprofessional helpers, or the effectiveness of 
has a systematic format for diagnosing 


training in helping now stem 
the present status of helper functioning and behavior. 
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2 This system may be used by beginning helpers to rate changes in 
their own personal behavior or the behavior of others as a result 
of helper training programs. In effect, diagnostic efforts by the 
microcounseling group now make it possible to integrate past 
research into present training practices (an important dimension 
when one considers diffusion of results). 


Let us assume that a counselor wishes to engage in a helper training pro- 
gram. The results of the diagnostic phase of microcounseling are available 
and may be used to assess the beginning functioning of helpers. This as- 
sessment may in turn be used to design training programs to increase helper 
functioning. Finally, the measures of diagnosis may be used to present 
competency-based data demonstrating that the program of paraprofessiona 
training is effective. Specifically, easily assembled and measured data are 
available to show that a program achieved its goals (cf. lvey and Gluckstern 
1974 a and b; 1976 a and b). 


THE SECOND STAGE—PARTICIPANT ACTION RESEARCH. The diagnos 
tic research described above is helpful in that the interview is describ N 
more completely, but such action research does not speak to the needs © 
individuals who may wish to develop their own conceptual frames an 
devices for helping others. Gluckstern (1972, 1973) provides an interesting 
illustration of how microcounseling canbe integrated into the needs 01 ° 
participant group. d 
A suburban community was faced with severe drug problems ae 
decided to build a program to combat this issue. (It may be noted that E 
diagnostic phase is built in already; the community has identified : 
problem—drug abuse.) Community members were involved in decidin 
what to do about the problem. Parents, schools, and social agencies mel A 
devise a solution. The first seven of the nine steps of participant A 


research in this project may be considered: (1) the emergence of the bee 
problem; (2) important parties were involved to define and develop ain 
all, 


the problem; (3) many areas of difficulty were brainstormed (but not 
more on this issue later); (4) and, (5) data were obtained and a decision 
action was made. There was no formal questionnaire or instrument 
veloped to increase community ownership and participation (steps 6 an a 
It was decided to institute a program for community training of pr 
professionals in drug abuse counseling. A training program combining in 
mation on drug abuse, group counseling, microcounseling, and commun’ a 
intervention was developed. Pre and posttesting on drug information, me 
personal relationships, helping skills, and community intervention kno or 
edge was conducted. Evaluation research revealed in each case that pi 


for 
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gram objectives were achieved. The relatively brief training program pro- 
duced knowledgeable, skilled individuals who had ability to counsel effec- 
tively on problems of drug abuse. 

_ Two levels of helping effectiveness were considered in this participant 
action research study. The first was the effectiveness of the training program. 
As noted, immediate testing following training and six-month follow-up 
revealed significant improvement in helping skills that was retained over 
time. The second question is the effectiveness of the total program in the 
community. Six-month and one-year data indic 
to a good start and was effective in that numbers of p 


Provided helping services. 
However, in the second year of this project, professional groups began 


enge the project aims. A large number of individuals were being seen 
wi, nprofessionals, thus threatening the image of more highly paid agency 
Orkers. The end result of this questioning was pressure on the community 
ne board and the eventual discontinuation of a heretofore successful 
n project that had been shown by demonstration and research to be 
effective. 
Pi: the failure? One needs simply to 
reall pant action research. The community 
| y adequate planning and involvement had not been completed. 
cle time-consuming, it seems increasingly apparent that effective pro- 
the "x Must include highly careful planning in the beginning stages or even 
te attempts at action will fail. In this case the action research clearly 
Or a the effectiveness of the program, but effectiveness in terms a 
regard ny and helping services does not mean that all interested parties wil 
Ne program as effective. 
The implications of this researc! 


seem 
Keene to be that action research mode 
S. Effectiveness of a program is insufficient unless strong community 


Pale is built in at the beginning and efforts are made continuously during 
tere to maintain solid interpersonal and professional Se 
Plan te research that does not take into account all arto es an 
fae Meet them may ultimately be ineffective. It is here that we ri 
evelo most clearly departs from traditional research etforts. Clearly, iy 
efforts Pment of an effective program is important, and traditional researc 
are most often satisfied at this level, but unless all community issues 


are consi * 
Onsidered, the action taken may be wasted effort. 


ated that the program was off 
eople were seen and 


ply to return to the nine-step model of 
appeared to be involved, but 


h example for the practicing counselor 
Is to be effective must still touch all 


TH 

ag THIRD PHASE—EMPIRICAL ACTION RESEARCH. A major question a 

5 De often asks is “are my interventions making a difference in the life 
Y client?” The microcounseling model is only recently being used to 
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determine the effect of action research interventions on the client popula- 
BR Perhaps the first illustration of this effort comes in Ivey’s 
microcounseling (1973) to work with psychiatric patients. The spe Guer- 
tervention was teaching life skills to the patient. Authier, ihat 
ney, and Kasdorf (1975), Carkhuff (1969), and others have sugges ta ett 
direct teaching of coping skills to clients may be more se ae at 
therapy, counseling, or interviewing that are, in a deula. 
helping people change their lives. Ivey's intervention ie o pron oe 
ing a patient in interpersonal interaction. The videotape was then isan a 
and patients determined what they themselves wished to change g une 
wide array of verbal and nonverbal behaviors was selected. paer alt 
then taught in microcounseling-like training sessions skills such as at en 
behavior, use of questions, appropriate nonverbal communication, a 
on. The immediate laboratory outcome was change in behavior as marge 
by both therapist and patient. Behavioral contracts were developed ee 
each individual to encourage generalization of learned cies pale 
and home settings. One important possibility for this type gt a hér 
evaluation research is whether or not a single individual reaches his © 
oals, u ‘an 
Let us look at this study from the four aspects of i aaah ge 
research. First, the intervention as described was performed. Secon sane 
cord of baseline behavior for the patient was developed by the ee ae 
patient. Third, the behavioral contracts were examined constantly to th, a5 
that learned behavior had generalized to the home or to the ward. Fou ation 
appropriate, changes were made in treatment plans when the interve 
was less successful. lied 
This model originated with psychiatric patients, but has been es 
to elementary school children by Goshko (1973) and adapted to = the 
training programs by Bizer (1972). In each case, the individual Hen ice 
behavior, demonstrates itin role-played, audiotaped, or videotaped pra 


« ife 
; ; Pr ior in daily | 
sessions, and then contracts to practice that specific behavior in 
situations, 


Similarly, 
studied in para 
reactions of cli 
bourne (1975), and Gluckstern (1972 
statements changed markedly after the 


on att 
: ; in 
professional or peer counseling programs by examin Chad- 


verba 
el ients 


|- 
| irre 
ves rather than about externa at 


i is need 
pressed more affect in the interview. What is nee of the 
a more detailed examination 
ng. 
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It may be seen that empirical action research is concerned with deter- 
mining whether or not a programmatic intervention makes a difference. The 
simple asking of that question reveals weaknesses of programs and areas of 
needed evaluation. Microcounseling, for example, has strong evidence that 
Significant changes are produced in individuals trained. The data, however, 
are more limited at the point where specific effects on client life style are 
Considered. This same issue may also be considered a problem in all types of 
Counseling interventions. The specificity of the goal-oriented microcounsel- 
ing format forces the helper to look more precisely at what he or she is doing 
and provides alternatives for investigating the usefulness of one’s activities. 

What are the implications of these examples for the practicing coun- 
selor? They seem to suggest that, first, specific interventions if clearly defined 
Can produce specific and measureable outcomes, and second, that it is not 
enough to show that an intervention has produced a short-term change. 

hat are the long-term outcomes of the intervention on clients? The mi- 
Crocounseling interventions with single patients, parents, and children illus- 
trate one way that the busy professional helper can indeed demonstrate that 
Ne or she is making a difference in the lives of others. It is possible to 

€monstrate empirically that counselors are effective, but we too often fail to 
examine ourselves, what we do, and its specific effects on those with whom 
we work. 


PHASE FOUR—EXPERIMENTAL ACTION RESEARCH. Relatively few 
Practicing counselors can be expected to find time to engage In action 
"esearch that involves carefully constructed experimental designs. Nonethe- 
ess, it is sometimes necessary to compare the effectiveness ot alternative 
Strategies to achieve the same goal. We often stay in a similar tired rut of 
Professional practice only because we know the route. Experimental action 
research can provide data that will help us move out of this rut and test our 
Present programs against alternatives. 


Toukmanian and Rennie (1975) provide one good example of experi- 


Mental action research. They wished to compare the ee ofa mi- 
cTocounseling training program in helping skills with that of pea iai 
Source development (HRD) model of Carkhuff (1969). Twelve students were 


ra : l ) 
ined with microcounseling an 
Sectio aar 
n and for the more subjective construc i / | 
p 8roups improved on skills and that the microcounseling group im- 
t . . 
Oved more on empathy dimensions. 


Vide 
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which treatment is most effective. Other examples of this type of research in 
microcounseling include Moreland, Ivey and Phillips (1973), Dunn (1975), 
and Hearn (1976). 

The seven-step model of experimental action research in this type of 
comparative study was outlined earlier in this chapter. The first three steps 
involve defining what methods one wishes to compare, making the hypoth- 
eses clear, and suggesting the methods to make the research design explicit. 
The issue of finding specific measures of counseling competence is more 
complex. In the study cited, measures used by microcounseling (behavioral 
skills counts) and by HRD (subjective empathy ratings) were both employed: 
The advantage of this approach is that measures are closely yoked to training 
methods. This advantage turns into a sometimes harrowing disadvantage in 
that training and research have become closely related and the danger © 
“teaching toward the test” becomes apparent. The yoking of outcome 
measures to treatment or training designs may be highly desirable, but other 
Important aspects of measuring the effectiveness of the program may be 
missed. Thus, it is suggested that both yoked and nonyoked measurements 
be employed. 

The remainder of the model (administration of test, analysis of data, 
and decision making based on the results) should be readily apparent. What 
is not immediately apparent, however, is that some of the important aspect 
of diagnostic action research, participant action research, and empirica 
action research are lost when the “more sophisticated” control group A 
signs are used. In effect, the more carefully you control your study, th 
greater danger of losing relevance to the clientele being served. 


INTEGRATING FOUR TYPES OF ACTION RESEARCH IN A LARGE-SCALE 
PROJECT. Microcounseling research has, of necessity, been developed if 
a piecemeal fashion. Although extensive diagnostic, participant, empier 
and experimental research on effectiveness exists, it has = 
been possible because of funds, time, and the developing state of the a 
to determine the full effectiveness of the program, This obvious criticism | 
microcounseling research can also be stated as a basic criticism of virtu? m 
all research. Few, if any, research programs or projects in helping OT T 
seling have been able to fill all the gaps of full evaluation of the effectiven® 
of a program. r 
One application of microcounseling currently conducted by a pn 
maceutical company illustrates the ideal of research that includes ah je” 
Tenien: or aeng research mentioned here. The problem is a eee 
eae em y on the subject of how can one improve specifications, nate 
product when to do so is clearly in the patient’s best interest? The ulti" 
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criterion is clear. Let us consider how this company applied the microcoun- 
seling model to an action research problem. 

The first stage involved careful diagnosis of the discussion with physi- 
cians about a product. Through examination of videotapes and audiotapes 
of those discussions, it was discovered that company representatives tended 
to only talk about their product and not inquire into the specific needs of the 
busy physician. Skills of questioning, paraphrasing, and summarization 
Were often missing from the discussion. The representative tended primarily 
to give information and worked to influence the physician to prescribe a 
Specific product when indicated. 

Out of the diagnostic work, a concept of the interview was developed 
and tested. It involved breaking down the interview into phases and gave 
Special attention to training in attending skills so that individual physician 
informational needs could be determined. Once that determination was 
Made, appropriate alternatives would then be suggested. Preliminary testing 
was made to determine whether the skills were indeed teachable, and pilot 
sales training programs were developed. Meanwhile, participants who were 
to be affected by the training program were interviewed and included ac- 
tively in all stages of the action research model. The training program was 
reviewed and commented on. Appropriate executives and other individuals 
Were consulted for their opinions and suggestions. ; 

The empirical phase of the research included two prime dimensions. 
The first is an extension of the diagnostic phase. Company representatives 
Were taught the skills and an effort was made to determine their views of the 
Program and their ability to acquire the newly defined version of the inter- 


Weise On the basis of all the above data, the program was revised and a 
Major field test in one state was implemented. Two types of criteria for this 
test could be identified. The first is the simple pre-post examination of 


Whether or not personnel could demonstrate the specific interviewing skills 
ties in specifically with 


ta k 

a in the program. This is a yoked measure that en 
© trainin d and crucial measure was defined as 

i s pro . The unyoked ani 5 

gee : aled that sales had increased. 


In à 
AE comparisons reve 


mits the conclusions one can make 
Id be simply that the attention given 


An in sales. Pre-post 5 
SSL te the lack of a control u 
program’s effectiveness. a 

Or Me company’s ee made the difference or that a new ve “ Ups 
drug was responsible. The empirical phase ot this researc neti 
A us whether or not the program “made the difference.” It is = e us 
Me unknown factor might be causal. It is important also to remember that 


this King ‘ 
2 i i i rticipation of all relevant 
pa ii hase included continual involvement and particip 


rties 
and decision makers. . i 
herefore, experimental research is currently under way nationally in 


ak 
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which two groups of pharmaceutical representatives have been taught the 
new training program and a control group has not. This should provide an 
effective test of the value of the program. The central criterion of the effec- 
tiveness of this program, of course, is the unyoked volume of dollar sales. In 
sales, skills may be “nice,” but unless they make a difference in the life of 
the company, they are irrelevant. 

This model of action research encompasses all phases. Microcounsel- 
ing research, still in its infancy after 10 years of work, here comes closest ta 
full bloom in an industrial setting. What this says about the values and 
integrated efforts of the educational establishment is, of course, most IN- 
teresting. Constructing such a large-scale research project would be impos- 
sible for the highly diffuse and individually oriented helping professions. 
Nonetheless, it seems apparent that we can use this large study as a model 
for the examination of microcounseling research in its totality, and this 
model can then be used by the practicing counselor in her or his own wor 
setting. Consider the following when you wish to introduce an innovation 
and include as many phases of action research as you can. 


Ls Diagnose the system carefully. Know what you want to have 
happen and the specific steps that might make it likely to 
happen. 

2. Involve participants actively in your work. They are the ones 


who will live with your research and will determine whether 
your time was wasted or not. 
3 Test your work to see its effect on clients. This may be as far 4° 
you get. But an innovation or intervention that does.not includ® 
some form of systematic empirical evaluation is akin to 
witchcraft. One must produce some data indicating that one 
making a difference in the lives of clients. 


is 


4. Where possible, develop experimental action research that 
involves testing of your treatment and testing of more genera 
unyoked issues related to your treatment. 


Finally, let us face the fact that most of those who read these words 4° 
not consider themselves researchers. Perhaps it is time for all of us to rethi" 
our role as practitioners and researchers. Practitioners who cannot evalu? 
what they are doing may not be doing anything. Researchers who © 
develop carefully controlled experimental design may not be doing anythin 
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either. Action research provides a bridge between research and practice. 
Action without research and research without action are all too often mean- 


ingless. 


IMPLEMENTING RESEARCH 
FOR ACTION 


In this section we delineate the stages involved in applied research studies, 
which should be applicable at least in a general way to all the types of 
research described in Parts 3 and 4 of this book. 


Selecting an Issue or Problem 


Select for research and action an issue or problem that relates to your 
day-to-day professional activities or to major decisions that must be made. 

he issue can also be brought to your attention by a concerned citizen of the 
community, colleagues, clients, or any other source. Are career information 
Services more effective when given in small groups or In large groups? Why 
are the mental health services given by your clinic used more by middle 
Class clients than lower class and minority clients? Is it better to train para- 
Professionals with a systematic method or is it better to be spontaneous and 
Informal? Is a program designed to make underachieving students do better 


academically actually doing its job? 


Defining the Problem and Involving the Relevant People 


After a problem is selected for study, the counselor convenes a group of 
People that includes all those judged important to the understanding and 
‚Mediation of the issue. For example, clients, employers, supervisors, 
teachers, parents, and others may be part of this group. The group is called 
together to brainetorta all the relevant factors involved in the problem, de- 
ine its boundaries, its causes, and, most important, possible a aki 
faton, This group in meet several times, adding more he Is i 
ih the purpose of clarifying all the relevant aspects. en es nn 
Phere the Problem is and involving those ae Lae ably particıp 
N are the most important elements in this B Rn 
Setti n Se he step is the case of a counselor working Hela aes 
'N8 faced with the reluctance of black inmates IN contrast = i ae ake 
wh tage of a program offering the opportunity to oe me ege E 
© in Prison, The staff running the program !> puzzled and unhappy 
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this situation. One action research approach to this problem is first to or- 
ganize a meeting of all the relevant actors including black and white in- 
mates, the director of the prison, the staff running the program, and any 
others. : 

In this group the issue of black inmates’ participation in all aspects of 
prison life is examined to determine whether this reluctance is a general or a 
specific response. If the problem is a general one, then actors taking parts in 
the larger scenario should be invited to join the group. Once the nature of 
the problem is clarified and ways of obtaining more information are out- 
lined, the group concentrates on developing ways of solving the problem. It 
is important that those who will have to implement the solution be involved 
in this group from the very beginning. 


Examining the Available Literature and Data Sources 


Once the problem has been clarified, plan to conduct or order a literature 
search before designing your study. It is quite easy nowadays to do literature 
searches using the ERIC or PASAR computerized systems. (See Appendix B 
for further information about these and other retrieval systems.) In particular, 
look for the types of instruments and measures other people have used. 
may well turn out that your problem has been solved by a study conducte 
by someone else, or that their method is just what you need to replicate IN 
your case. Do not, however, spend too much time in researching the litera- 
ture. It is easy to get bogged down in reading and not deal with your 
problem. 

If at all possible, use existing data sources such as the United States OT 
town census, State Department of Education data, student records, already 
collected test data, or other such sources. Do not plan to collect new data il 
you can possibly find out what you want to know from existing data sources: 
The reference librarians of public or university libraries can be of major help 
in locating data sources. If, for example, you are in a school setting and the 
principal is concerned about the increasing number of students dropping out 
of school and you want to determine whether this is a true problem O" 
merely an impression of the principal, you should consult national data fo" 
dropouts published by the National Center for Educational Statistics a" 
local data collected by the secretaries and unit chairpersons of your schoo! 

Another example of making use of available data sources would bea 
helper working in a community mental health center who is given the 
charge of determining the needs of the elderly population. The first steP 
should be to consult the Census Reports and determine how many elde" r 


are located in the region by inspecting the county census and the town 
resident lists. 
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D soe 
etermining the Research Strategy 


Once th 

$ he pr ; fi 

ehe ns has been defined, a research strategy that leads to study- 

ahs “Aine ws snes should be followed. The basic questions you should x 
researching the questions properly? Will the questions that we 


are rese R 
sear i : : 
ching bring us the answers that we need for action? Why are we 


researchi 
n - AA ae 
g these questions?’” Often counselors with the best of intentions 


engage j 
R un N studies that do not yield the answers they need. 
Wants to find ca Jep aes of th is situation is a high school counselor who 
order to PEREON 7 effectiveness ot a vocational orientation program. In 
questionnaires 4 ps ner the program is effective, the counselor usually sends 
Whereabouie ; he the seniors who have graduated asking them about their 
and er ter they left school. The counselor then compiles the data 
are working 3 io series of percentages of how many students went to college, 
RR A in the armed forces, Of have gotten married. 

opting for coll nselors assume that if many students from their schools are 
Proportion of eRe they have been doing a good job. The truth is that the 
Social class | students going to college is probably more a function of the 
at the mr nd of the students than of the quality of the counseling 
number of they attend. Also, a very tight job market will increase the 
College it dn going to college regardless ot whether they receive a good 
eir Sa ken or not. IF counselors want to assess the effectiveness of 
salee orientation program, they should follow a different research 
Orientation ir should at least obtain measures, before and after the career 
sess, and tH program, of the amount of career information the students pos- 
ho are he clarity of their vocational choices. Ideally, a group of students 
different I receiving the intervention are served with a totally 
Pre and Sen could serve as a control group and would also be tested 
€ able to st intervention. Following this research strategy the counselor will 
answer the basic question: What are the effects of the vocational 


ori 5 
entation services? 
p s? 


or who 


Selecti 
cti 
ing the Appropriate Measures 


danda research strategy designed 


Nee th 

ne e 
to dea ie has been clearly define i ; 
j ith it, appropriate measures must be found or constructed for the 
use an existing test or scale or inventory 


JOr vari 
r aria f : 
Ather thee bles. If at all possible, 3 
Creating your own. It is ver cult and actually quite a techni- 
i Iso, results obtained 


Cal 
Prob] 

i e : 

With m to create a good measur! t 

rd to compare with those of other 

sure that has a history, you can 


ah 
Stud; Ome- R y 
Udies ip made instrument will be ha 
you use an instrument or mea 
using the same device. Also, 


Co 
Mp 
are 
your results with those of others 
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someone else will likely have done the hard work of establishing evidence 
of reliability and validity. In selecting an instrument, look for those that (1) 
measure what you are interested in, (2) have reasonable reliability indices, 
(3) have been used in projects similar to your own, (4) seem to have some 
conceptual relevance to a larger body of theory, and (5) are not offensive to 
the general public. Some books where you can find measures already de- 
veloped and available for use are presented in Appendix A. 


Delineating the Relevant Populations 


Determining whom to focus on is an important aspect of all research. The 
population to be used will of course depend on the nature of the problem. In 
cases such as those typical of diagnostic and participant action research, 
many community groups would have to be interviewed or sent question- 
naires. In experimental and empirical action research, groups receiving the 
intervention will be the target of the research. 


Finding a Comparison Group 


If you are trying to determine the effectiveness of one method of interven- 
tion, try to find a comparison group that is either receiving another treatment 
or no treatment at all. It is possible to use the experimental group as its own 
control by comparing pre and postmeasures, but the use of a separate com- 
parison group treated the same as the experimental group—except for the 
method of intervention that is being studied—permits firmer conclusions. 


Trying to Use Pre and Post Measures 


In designing a study, try to use pre measures as well as post measures ON 
your groups. If you cannot arrange for a control or comparison group, at 
least obtain pre and post data on the group you are servicing. If the nature of 
your problem does not allow this, then you must settle for post measures 


alone, but it will then be very difficult to reach any conclusion as to whether 
any changes occurred. 


Using Simple Statistics 


Remember that a major component of action research is feeding back the 
findings to people who do not know statistics. Plan to use bar graphs, means, 
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and percentages to present your results. Use the relatively simple t-tests or 
chi-square to test for statistical significance of any differences that were 
found. Plan your research so that you can use simple statistics. 


Meeting Your Deadlines 


are oriented toward assisting decision mak- 
a given date. Information arriving 
at decision. Keep in mind the 
ch so that the results will be 
sion makers can understand. 


Many action research projects 
ing. Decisions must usually be made by 
after that date is useless in helping to make th 
deadlines and design and conduct your resear 
available when needed, and in a form the deci 


Feeding Back the Results to Relevant Others 


The people most concerned with the problem you are researching should be 
Participating in the study. All people involved and those for whom the 
action research is relevant should be informed about the findings of your 
research. You should plan to spend as much time informing people about 
the results as you spend in actually conducting the study. In that way the 
results are more likely to achieve change led by those who are in a position 


to translate them into action. 


Modifying Your Practice 


arch indicate that one method or combination of 
other interventions, then modify your prac- 
rventions prove effective, start again the 
have another action research problem. 


If the results of your rese 
methods is more effective than 
tice accordingly. If none of your inte 
Process just described since you NOW 


THE DIFFUSION AND 

IMPLEMENTATION OF 

RESEARCH FINDINGS 

unate situations in the field of counsel- 
findings have in the practice of the 
Profession, Many counselors are not aware of major research findings; many 
just do not eh journals. Garvey and Griffith (1965) report that about 
One-half of the research reports in journals are read or skimmed by only one 
Percent or less of a random sampling of psychologists. The most striking 


One of the most frustrating and unfort 
Ing is the small influence research 
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feature of the process of dissemination of research findings in psychology is 
the small amount of information that is easily available to the professional 
and scientific community (Garvey and Griffith, 1965). The public dissemina- 
tion of research findings occurs late, takes only a few forms, and in its final 
presentation has a very small audience. Actually, the national professional 
conventions such as those of the American Psychological Association, 
American Personnel and Guidance Association, National Association of 
Student Personnel Administration, and others occupy key positions in the 
dissemination process, because they give the earliest and most democratic 
access to research findings. 

Dissemination in any field is the dynamic process between the system 
of dissemination and the behavior of the professional within the system. The 
greatest contributor to the dynamics of the system is the individual profes- 
sional; it is the individual counselor who determines the effectiveness of the 
dissemination process. The counselor is involved in the diffusion and im- 
plementation of findings in two ways: as a producer of research and as a 
receiver of the research findings of others. The counselor who is producing 
research findings wants to make the results known to others and to see them 
effectively implemented. The counselor accomplishes this role by reading 
papers at conventions, publishing articles and books, and offering work- 
shops, courses, and training sessions. The counselor as receiver of the re- 
search products of others wants to know where the specific information 
needed is and how to put it into practice. In order for counselors to fulfill this 
role, they must solicit information, attend meetings and workshops, take 
courses, and read journals and books. 

Each of these two roles is very important to the advancement of the 
profession of counseling and to the professional development of the indi- 
vidual counselor. For these tasks to be accomplished, the counselor has tO 
be seriously committed to their realization and be willing to interact actively 
with other professionals and the counseling establishment. In order to pre- 


pare the counselor to fulfill these roles effectively, we will discuss the follow- 
ing topics: 


Characteristics of present dissemination-implementation models 


Factors important in the dissemination and implementation process- 
Dissemination Models 


natural cycle of research is: first to be generated, then disseminated and 
iffused, and finally implemented or utilized. In this section we concentrate 
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on the way research is disseminated, that is, moved from the originating 
researcher to other researchers or possible users. 

Research dissemination literature is extensive and contains many mod- 
els of the dissemination/utilization process (Davis and Salasin, 1975; Shas- 
kin, Morris, and Horst, 1973). One of the most complete categorizations of 
all the available diffusion/implementation models is that of Havelock 
(1975). He classifies available diffusion models into three types: the research 
and development perspective, the problem-solver perspective, and the so- 


cial interaction perspective. 

The research and development perspect 
developer perceiving the need of the consumer for a particular innovation or 
Product. The developer identifies a problem, gathers data, invents or designs 
a package, tests and evaluates the product, promotes, informs, demon- 
strates, trains, and helps the consumers use it. The consumers in turn be- 
come aware of the innovation, idea, or package; show interest, evaluate it, 
try it, install it, adopt it, and finally institutionalize it. In this model the focus 
is on the activity phases of the developer as he or she designs a potential 
solution, In the field of counseling this approach is best exemplified by the 
aptitude, interest, and intelligence test materials developed by researchers, 
such as the Differential Aptitude Tests, the Strong-Campbell Interest Inven- 
tory, the Minnesota Multiphasic Personality Inventory, and many others. The 
researchers produce these materials because they believe that practitioners 


Need them to fulfill their function. dens 
In contrast to the research and development perspective that focuses 


on the originator of the innovation, the problem-solver model centers its 
attention on the receiver. The consumer initiates or senses a need and sets 
Out to find possible ways of fulfilling it, usually by establishing a relationship 
with an outside expert or resource person. The way in which the problem is 
Solved depends on the resources available in the particular field and the 
knowledge the individual or group has of the availability = oa! > 
Sources. The distinctive quality of this approach is the we ED an ` 
€ Consumer. The receiver searches for the solutions, et is oe goals a 
Priorities, weighs and evaluates possible solutions, selects the best poss! e 
ternatives, a ans for im |ementation. er ER 
An en m in a counseling setting is a 1 
which one needs more information about a certain area such as he 
Counseling in schools. The counselor begins to search out ec? aie or 
Sing these needs: this might include a literature search through the or 


PASAR system to learn about the work of others who are sounen in 

Schools wi 5 f relevant studies on this topic In 
SW : summary © A 

Dee find out from colleagues or through 


© Journal of Counseling Psychology: ort 


ive begins with a scientist- 
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reading professional publications who can give special training in the parent 
counseling area. The counselor is the sole initiator of the actions in this 
model. 

The third model, the social interaction perspective, like the research 
and development model, centers its attention on the producer of the innova- 
tion. The producer determines the receiver’s needs and sends along a pack- 
age or product for the receiver to accept or reject. The social interaction 
networks that make possible the diffusion and implementation of the new 
idea are the focus of attention of this approach. Proponents of this model 
believe that the key to the adoption of an innovation is the social interaction 
that takes place among members of the adopting group. Most of the work in 
this area has been done by rural sociologists interested in the adoption of 
agricultural innovations; they have been especially interested in the process 
individuals go through in adopting innovations. An example of this ap- 
proach would be studies focused on the social networks used by counselors 
in obtaining information about a certain idea and to whom they passed on 
this information. The results of the research would enable those people 
interested in disseminating information th rough that system to know who are 
the important gatekeepers and what are the most important contacts in the 
transmission of the information. 

The best known model of the innovation adoption process has been 
postulated by Rogers (1962). He proposes a five-stage process composed of 
awareness, interest, evaluation, trial, and adoption. The first stage, aware- 
ness, consists of exposing the individual to a new idea; it is hoped that this 
exposure will create a need for that idea. The individual is not actively 
seeking a new idea but a government agency, a private company, or col- 
leagues are trying to stimulate the counselor's interest in one. The interest 
stage is characterized by active seeking of information about the innovation. 
At the evaluation stage the individuals mentally try out the innovation in 
their setting. 

The trial stage is the one in which the prospective user actually tries out 
the innovation on a small scale. Adoption is the final stage in which the 
results of the trials are evaluated and the decision is made to continue using 
the innovation or to reject it. In agricultural science this model has been 
operationalized thorough the extension agent. In counseling there have not 
been change agents of this nature, except for some work in the rehabilitation 
area that is described in Chapter 10. The field of education has tried a similar 
role and labelled it the education extension agent. Because of its importance 
and direct applicability to the field of counseling the education extension 
agent is discussed below, 


Three states participated in the education extension agent program, 
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conducted mainly in rural and small town areas (Siebert, 1974). Seven 
extension agents were employed full time to meet with clients and help 
them diagnose their needs. When the client had a clear idea of what she or 
he wanted the agent transmitted this information to a retrieval staff who 
Performed either computer or manual searches of ERIC, CIJE, and other 
Standard educational resources. The information obtained, which might be 
In microfiche or hard copy and might include abstracts, bibliographies, or 
other contents, was then delivered to the client. The extension agents helped 
the clients interpret, use, and adapt the information. 

The program was successful both in its diffusion and knowledge utiliza- 
tion functions. A much larger percentage of requests was generated from 
areas using this program than from other areas. In the actual use of the 
information obtained, half of the respondents reported that it had given them 
New resources for helping other staff members and more than a quarter said 
that it had helped soive administrative problems. Another fifth of the users 
Claimed that it had assisted them in developing instructional packages. 

These results are very promising especially when one considers that 


this was the first time such a system was tried and people were not used to 
this type of service. Siebert points out that among the factors responsible for 
e expertise resided in the use of the 


© program’s success were that th J 
research resources and was independent of the agent; the extension agent 
Was not presented to the clients as a change agent or problem solver but as a 
simple conveyor of information; and the clients were given the freedom to 


define their needs and choose their solutions. This client-controlled ap- 
Proach, suitable for independent-minded professionals who like to follow 
their own styles, is very appropriate for the field of counseling. 


Factors for Effective Dissemination and Implementation 
cessful dissemination and implementation 


Of research findings can be organized in three realms: the characteristics of 
e particular innovation or finding, the characteristics of potential consum- 


T , f the diffusion and utiliza- 
Í ® Of the new ideas, and the manner and extent 0 
On effort, 


Thef 
"€ factors conducive to the suc 


CHARACTERISTICS OF THE INNOVATION. Glaser (1973) postulates seven 
attributes that he considers important elements in the eventual acceptance 
„New idea or behavior pattern: credibility, observability, relevance, rela- 
ive a Vantage ease jn understanding and installation, compatibility, and 


trialiþij; “1; 
alibility, divisibility, or reversibility. 
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The first of the attributes characterizing an innovation is credibility. A 
credible innovation or research finding is one that is espoused by a reputa- 
ble source or is based on sound evidence. An example of a credible innova- 
tion in the field of counseling is behavior modification, which is being 
increasingly adopted by counselors for use in their practice. Among the 
reasons are the extensive research literature documenting the effectiveness 
of behavior modification techniques, the practicality and generalizability of 
the theories underlying this modality, and the stature and reputation of 
Skinner and other behavioral theorists. 

Observability of an innovation concerns its concreteness and 
tangibility—that is, how much can the practitioner actually observe the 
method in use? Using behavior modification as an example, the opportunity 
for the practitioner to see behavior modification techniques being employed 
with a client and to try using them under supervision would enhance the 
probability of the counselor accepting the method and trying it in practice. 

Relevance pertains to the degree that an innovation fulfills an urgent 
need. Innovations that touch on those areas of concern to a counselor (such 
as therapeutic counseling) are more likely to be given serious consideration 
than those that deal with less central areas. Again using behavior modifica- 
tion techniques as an example, it is easy to see that because of its demon- 
strated effectiveness in doing a task that counselors consider of utmost prlor 
ity, behavior modification has been accepted by more counselors than many 
other new modalities in this field. 

Relative advantage means that an innovation, in order to be adopted, 
has to prove its superiority over other competing methods currently in prac 
tice. For counselors to change their ways of behaving they have to be certain 
that the new approach is worth all the trouble of learning a new method. 
Thus, a counselor who was operating with satisfaction under a Rogerian 
model would have to be convinced of the superiority of another method 
before deciding to change to another approach. 

Ease in understanding and installation is another quality important to 
the successful acceptance of an innovation. Ideas or products that are har 
to install or to understand are less likely to be adopted. For example, Cour- 
seling methods utilizing video feedback techniques are less likely to be 
accepted and tried than techniques that only require talking between tWO 
people or a group of people. : 

The compatibility of an innovation refers to the congruence it has with 
the values, ways of functioning, and facilities of the counseling setting an 
the counselor. Returning to the behavior modification example, incompatl- 
bility is one of the greatest barriers in the acceptance of this innovation: 
Many counselors’ values are in conflict with the conscious manipulation 
and control used by social learning based therapies. Counselors who pel: 
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ceive behavior modification in this way often reject its use because it clashe 
with their basic values. ‘ 
a Tie EE TE ies 
SEE pte: ry ou ation. The more flexibility an 
ar Innen possesses, he greater its chance of being implemented. Thus, if 
en ation can be tried out one step or part ata time, the system has an 
ratha: TS of accepting it. Most innovations are never really adopted, 
ne ui are adapted to the needs of the receiving organization. The 
me ei ble an innovation is, the greater its likelihood of being accepted 

Orporated into the system. 
ee nr counselor who has produced a new technique or idea 
anne: 7 y the factors discussed previously and try to consider them in 
amii the diffusion and implementation of the idea. If after careful ex- 
en ation the counselor discovers that the innovation will have difficulty in 

e of these areas, efforts should be made to eliminate or lessen the effect. 


Dea CHARACTERISTICS OF THE POTENTIAL CONSUMERS OF THE NEW 
daa Effective use of research findings includes at least these three 
an acteristics of the consumer organization OF institution: the leadership 

Organizational climate; characteristics of the staff; and the financial 


reso x = 
urces, Each of these is now discussed. 


Leadership and Organizational Climate. 
ors in the eventual adoption of an inno- 
d the organizational climate present in 
g introduced. As stated by Glaser 
ts a role model of willingness to 
a style that encourages a non- 
” is a very important com- 
hatever sétting a counselor 


al, the most important fact 
e a the type of leadership and ti 
(1973 ing in which the change 15 bein 
En 436), “A leadership style that se 
efensi n challenge of one’s own operation, 
ve, self-renewing organizational climate 


Pon . 
Works in the acceptance of new ideas. In wł i 
Works, the style of leadership of the administrators and the climate of the 


instituti i 
s stitution will determine to a great extent the amount of change that is 
hice from the outside or encouraged from the inside. The following 

Ote from the Rand Corporation Change Agent Study (Berman and 


Cla à 2 a e 

ughlin, 1975) illustrates this point further: 

In Particular, the local organizational climate and the motivations of the project 
d success and on change in teacher 


Partici BS å 
io Pan had major effects on perceived $ i 
havior, More specifically high morale ot teachers at a school, the active 


SUPport of principals who appear to be the “gatekeepers ” of change, the general 
Support of the superintendent and and the teachers’ willingness 


district officials, 
0 ex = ‘ he chances of teacher chan 
Pend extra effort on the project e = 


all increased t 
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and perceived success. The attitudes of administrators in effect tell the staff how 
seriously they should take the project’s objectives. Unless the project seems to 
represent a district and school priority, teachers may not put in the extra effort 
and emotional investment necessary for successful implementation. Thus, when 
these elements were not in evidence, projects were likely to break down or be 
implemented symbolically without significant change. (p. 20) 


The support given by administrators to the efforts of their staff to seek 
new ways of performing their jobs and to keep abreast of developments IN 
the field is extremely important. Administrators who do not value and re- 
ward staff information-seeking and implementation of new ideas will have 
outdated, poorly informed, and demoralized staff members. The behavior of 
the administrators in this connection will be modeled by the staff; when the 
leaders show interest in keeping abreast and are open to new ideas and 
experience, the staff finds it easy to do the same. However, if the adminis- 
trator does not think that research has anything to offer to practitioners an 
that new ideas are not worth pursuing, the front-line professionals will have 
a difficult time trying to further their growth. 

The support of the administration is of crucial importance when 4 
practitioner learns about a new idea and wants to try to implement it in his 
or her own practice. Encouragement, alternative suggestions, and accomp- 
lishment of the administrative tasks that will make possible implementation 
of the innovation are vital. | vividly remember one director of guidance 
services who, after | presented him with my ideas for a new program, er 
sponded: “Go home and think about the possible dangers that this idea 
could bring and then call me back.” A year later the innovation was adopte 
by some high school teachers with whom I had discussed the idea. The town 
newspapers carried several laudatory articles on the project and the town 
annual report selected a picture of the project in operation as its front cover 
Another administrator, not concerned about the dangers but about the 
benefits that this project could bring to the children, students, and parents i. 
the town, had helped make it a reality and was proud of being the moving 
force behind its implementation. é 

Indifference to an innovation is often as prejudicial to its enactment a 
a negative reaction. Administrators and staff members who react negative Y 
to new ideas and those who do not get involved constitute a kiss of death fo 
change (Berman and McLaughlin, 1975). 


Staff Characteristics 


j " er 
The quality of the staff of the potential user of the innovation is anoth 
very important factor in the adoption and successful implementation o! 
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nn The staff has to be competent and able to carry out the new 
een = properly. Not only must the administration be interested, but the 
wei, acct going to be directly involved in using the ideas or new patterns 
deliver pe concerned and eager to participate. Thus, even if a new way of 
ng after-care services is approved by the higher level administration 
of the outpatient unit of a mental hospital, it will not be successfully im- 
plemented unless the front-line personnel trying out the new method feel 
Positively toward it. 
l In addition to the level of competence, the staff's degree of professional 
Motivation and commitment is another very important factor in the utiliza- 
tion of research findings. Counselors who perceive themselves in process of 
Continuous growth, learning, and changing are the ones eager and willing to 
use and implement new ideas. Counselors with low interest in their profes- 
Sonal competence, those who feel they have reached the peak of profes- 
Sional excellence, those who feel threatened by the creative work of others 
a who are rigid or afraid of learning new things will usually not be in- 

€rested in learning about and using the new developments In their field. 
read Counselors and administrators who define their role to include time to 
journals and books, review the literature on a certain topic, attend 
Meetings, and other similar activities tend to be more innovative. A few 
Ours a week spent reading the most important journals in the field of 
Counseling will save ten or more hours à week trying to re-invent the wheel 
a designing tests that others have already constructed or programs sr 

Ners have already tried and evaluated. Even if a counselor does not atten 
National meetings, a weekly reading of the most important counseling jour- 

als will help keep one in contact with new developments. 
The practitioner who is to understand research articles needs a certain 
ä nowledge of research methods such as elementary en reading 
Imsrabhs and tables, research design, and sampling procedures. ee. 
Portance is the necessity for the practitioner to evaluate research in ings. 
Ounselors should be able to answer such questions as: Does this study 
emo i eling is effective? Is the 

san. trate that the new method of doing couns@ | 8 4 
up MS on which this test was normed representative of H population 
ee ae A e topic ch findings nt 
e practiti w how to K 
thane! reien es pe a fail to point out the practical uses Ol 
fe Work or do not discuss fully the considerations that should be ore 
oie account when their findings are implemented. Research courses 

nselors should give training in translating research findings into practice. 
ANY excellent research findings lie dormant waiting for an imaginative 


Practiti 
titioner to put the ideas into use- 
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Financial Resources of the Organization. 


The financial resources needed to put new ideas into practice and to 
keep abreast of research findings are a very important component of the 
utilization and dissemination system. Without appropriate funding to buy 
supplies or to hire the new personnel needed, an organization cannot intro- 
duce new patterns of behavior. Money to provide a well-stocked, up-to-date 
professional library or access to one is another necessity. Counselors need to 
read books, journals, and magazines, do literature searches, and perform 
other educational tasks in order to get acquainted with new innovations in 
the field. Money to attend professional meetings both locally and nationally 
is another serious need. 


THE MANNER AND EXTENT OF IMPLEMENTATION EFFORTS. The way in 
which a new idea or behavior pattern is diffused and implemented is a very 
critical factor in its eventual acceptance and adoption. In the action research 
models described previously, dissemination and implementation efforts are 
built in from the initial stages. Researchers work hand in hand with com- 
munities, social agencies, schools, and other practicing organizations from 
the very beginning. Because most models of research and evaluation fail to 
involve the front-line practitioner from the start, they have great difficulty 
having any effect on the practical operation of the programs they evaluate. 
Thus, among the first things researchers interested in implementing their 
findings must do is to involve in the project as many of the possible users ot 
the results as they can. 
However, not all research projects can follow this principle. In some 
instances participants cannot be included and in others when an innovation 
is being disseminated on a larger scale a different model has to be used. 
Many have found that personal contact between the possible adopter an 
the innovator is the most effective route (Glaser and Wrenn, 1971; Fall 
weather, 1971, among others). Workshops, information packages, conter 
ences, and other means of dissemination are not sufficient, As Glaser (1973) 
states: “The most effective single means that can be used to increase infor 
mation utilization is personal interaction, and the strategic contact is the 
well informed colleague (gatekeeper)” (p. 438). n 
When personal contact between the researcher and the possible user b 
not possible, a valuable approach is the linking agent. This person helps t° 
connect the counselor in need with the available resources. The education 
extension agent experiment (Siebert, 1974) described earlier is a good €% 
ample of this approach. (See Kauppi’s description of the utilization specialist 
program in the rehabilitation area in Chapter 10.) Other important factors In 
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the successful adaptation of an innovation are adaptive planning, staff train- 
ing keyed to the local setting, and local materials development (Berman and 
McLaughlin, 1975). 

To facilitate the transmission of their findings to the practitioner, re- 
searchers should ask in their grant proposals for dissemination and im- 
plementation funds that will enable them to offer free workshops, training 
sessions, and continuous support to counselors while they need it. Funds 
can also be used to pay for a linking agent that will bring together the 


Practitioner and the research findings. 


CONCLUSION 


The purpose of this chapter is to make clear to counselors that there is an 
imperative need to do research and to make use of the research findings of 
others, The action research tradition was presented because it fits so well 
ation of the front-line counselor. This chapter has 
offered a basic set of principles and practices that should serve well for all 
the practical research that counselors can engage in and use in their work. 
As such, the chapter provides a foundation for the remaining chapters in Part 
3, each describing in detail one type of research approach. 

Most of the studies that counselors can do on the job are aimed at 
action of some kind—either to confirm the merits of current apa or to 
Suggest changes. The traditions of action research are still Peny vali & the 
Counselor plans a study, conducts it with maximum invo esate u col- 
aboration of all concerned, and then applies the results to the pro em at 
hand. The reader may find it helpful to return to this chapter N while 
examining the many research methods and research settings that comprise 


Most of the remainder of this book. 


with the practical orient 
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CHAPTER 4 
Studying Individual 
Change 


Jane L. Anton 


2 counselors, our primary concen is the growth and change of individuals. 
egardless of setting or theoretical orientation, we are all faced with two 
Mportant questions: Are the clients | am currently working with changing In 


esired ways? And, how can | be more effective with future clients? To 
miwan the first question, We usually rely on “clinical judgment,” “intui- 
foy or clients’ answers to such questions as "Are things getting any bet- 
er?” Unfortunately, all of these methods produce unreliable answers. In 
Order to answer the second question, we ought to be aided by research in 
counseling, However most counseling research fails to meet the simple test 
o relevance suggested by Krumboltz (1967, p. 191): “What will counselors 
a differently if the results of this research come out in one way rather than 
another?” Consequently, alternative methods for integrating research and 


Practice ; 
actice in counseling must be used. ser 
This chapter presents an introduction to and description of methods for 
vidual. These methods have two major 


the 

Systematic s <- single individua 

a atic study of a single in ee bes 

vantages, First, they allow us to take a more intimate look at the process 
a i and examine effects of counseling on 


scured by traditional counseling re- 


Search methodology Second, these methods are particularly appropriate for 
he Practitioner/researcher in counse ing. Although the traditional distinc- 


'on bei li ractice still exists this 
tween i earch and counseling P A 
counseling 1 be reduced. Valid and well- 


se i 
er of research and practice can ‘oe a 
ed research can and should be carried out by counselors IN practice. 
As in learning how to be an effective counselor, there is no substitute 
Xperience, experimentation, and practice in learning how to be an 
tive researcher. This chapter presents the rationale and the basic princi- 


for e 
effec 
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ples of observation, design, and analysis for single subject research in suffi- 
cient detail so that you will begin to apply these methods and techniques. 
Only by trying, failing, and trying again will you begin to experience the joy 
and satisfaction of improving your own effectiveness and contributing to the 
understanding of others. 


WHATEVER HAPPENED TO 
THE INDIVIDUAL? 


The systematic study of an individual is certainly not new to the fields of 
counseling or psychology. Some of the most significant breakthroughs in 
clinical work have been a result of work with individuals (Dukes, 1965; 
Lazarus and Davison, 1971). Allport (1937) and Lewin (1935) stressed the 
importance of the systematic study of the individual. Allport championed 
the “idiographic’’ method while Lewin argued that understanding and ex- 
plaining individual performance required an examination of the “here and 
now” of contemporary events (Thoresen, 1972). The work of B. F. Skinner 
(1945, 1953) is based totally on the systematic observation of individual 
animals in highly controlled environments. 

But this is an age of science, and counseling researchers, like other 
social scientists, want to be “scientific.” We know that individual petor 
mance changes from situation to situation, and from person to person. IN 
order for the results of a specific study to be generalized to other persons an 
situations, we must somehow account for this individual variation. Follow- 
ing the lead of psychology, the physical science model, with its emphasis ON 
the ‘‘average’’ and resultant statistical procedures, has been adopted as the 
basis for counseling research. This model not only fails to consider 
individual performance as lawful and systematic, but treats the individual as 
a random event or unexplained variance. Consequently, in our quest tö be 
scientific, we have all too often substituted “statistical control” for disci- 
plined inquiry. n 

Much of counseling research is devoted to correlations between au? 
descriptive measure and another, such as the correlation between a pa 
ality inventory and an academic achievement test. Although various statis j 
cal procedures allow us to determine the extent to which two or mor 
variables correlate, the conclusions from such studies cannot legitimately Be 
interpreted as describing causal relationships, although there is a great temp 
tation to do so. In addition, such designs provide absolutely no information 
to the counselor concerned with the factors that influence a particular 
student’s academic achievement. 


Recognizing the limitation of correlational research, many counseling 
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r 
en er <a for more experimental research in counseling 
a. > bois ). nfortunately, experimental” research in counseling has 
En nee br ymous with comparative group designs (Campbell and Stan- 
= un er counseling experiment involves at least two groups: 
re ental group, which experiences the counseling treatment, and a 
erie a ken which does not. In such an experiment, the usual question 
ae wir her the average performance of one group differed significantly 
Beech at of the other group(s). In such an experiment, the subject's perfor- 
er is seldom observed during treatment. Usually, an estimate of the 
p's pretreatment performance, as assessed by some pretest, is compared 


with the group’s posttest. 


In such a design, statistically significant differences in the average 


ee of the two groups does not demonstrate that the difference was 
forma ve or all subjects (Chassan, 1967). The reliance on the average per- 
Aita oe of a group obscures the effects of a treatment on individuals. 
Wifes the average performance of a group may improve, specific indi- 
tile s may in fact “get worse, ‘ora few subjects may change dramatically 
sain most subjects remain unchanged. And yet, in the view of most coun- 

g researchers, the comparative group design represents the only 


Proper’ research method. 
the ; The emphasis on statistical analysis has not only mathematically erased 
€ individual in counseling research, but has furthered the separation be- 
ria researcher and practitioner. Most counselors were traumatized rather 
a Ra ia by their usually brief introduction to counseling research in 
Bro ate school, and have neither the time nor facilities to perform elaborate 

UP designs. 
Stig ie inquiry requires the u: 
onsiderating public arena, yet no SI 
tion for the phenomenon un 
Perimentat, methodology and any rigid © 
Ments, C ion can only lead to a reduction in 
Includi Onsequently, counseling rese 
ng the systematic study of a sin a 
Stu © do need alternative methods for the description and experimental 
ela a individual behavior, but it is a mistake 10 assume that the absence of 
7 rhe, Statistics and group designs will make counseling eel 
inking We must return to the difficult and often painstaking process O 
the e cae design or analysis procedure, 
Crea A nselor/researcher is required to observe, describe, think, sein’ 
Specifi analyze, and continually invent new procedures that match the 
€ Problem to be studied. 


zed procedures to permit 
ethod is valid without 
der investigation. A science is only as 
gid orthodoxy in psychological ex- 
the usefulness of such experi- 
tilize a variety of methods 


he use of standardi 
ngle scientific m 
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Although a “single subject” in counseling research usually refers to an 
individual person, the “subject” can also be a larger unit such as a school, 
family, classroom, or community. In fact, while these methods are seldom 
applied in counseling or psychological research, their use in other social 
sciences such as anthropology, economics, political science, and sociology 
has been extensive. 


QUALITATIVE METHODS FOCUSING 
ON AN INDIVIDUAL 


The primary focus of this chapter is to examine experimental methods for the 
study of a single subject, but there are also a variety of useful descriptive 
methods (Lofland, 1971; Franklin and Osborne, 1971). The case study is 
most often used to describe individuals. Although case reports from practic- 
ing counselors lack the degree of control and objectivity to provide informa- 
tion on why something is happening, a careful description of what is hap- 
pening can play several important roles in the scientific study of the indi- 
vidual. Specifically, case studies have been used in the following ways- 


1. Case studies can provide valuable information on specific types 
of individual behavior that occur too infrequently to be studied 
repeatedly. For example, the relatively rare phenomenon of 
multiple personality was reported by Thigpen and Cleckley 
(1954). The now classic case of Eve White, Eve Black, and Jane !5 
one of the few detailed accounts of this phenomenon and, 
consequently, the primary source of information about it. 


2 The description of a single case can provide disconfirmation of 
allegedly universal beliefs. For example, Freud’s belief that his 
female patients’ reports of sexual assaults by their fathers or 
uncles were accurate descriptions of events was changed when 
he learned that one of his patients could not have been present at 
the time of the incident. As a result of this single case he realize 
that some of these assaults were fantasies and began to rethink 


the ‘‘meaning’’ of his patients’ recollections (Davison and Neale, 
1974). 


Perhaps the most important role of a case study is to generate 
“hunches” about the nature and causes of individual behavio™ 
Because the case study is often exploratory it is possible to 
examine new and perhaps important hypotheses that would not 
be uncovered in controlled investigation. This use of the case 
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study requires that the counselor collect extensive data aboutthe 
subject. If we want to study an individual child’s disruptive 
behavior, for example, it would be wise to examine not only the 
frequency, timing, and conditions of the behavior but also 
numerous other factors about the child whether or not they 
appear to be related to the problem—family situation, health, 
academic achievement, self-concept, physical and social 
development, and so on (Miller and Warner, 1975). 


Although the case study can be used to answer questions about what is 
appening now, different kinds of methods are required to answer such 
Questions as “Is my client changing? If so, is that change related to some- 
thing I did? If so, what was it?” This leads us to the quantitative methods. 


QUANTITATIVE METHODS 
TENSIVE EXPERIMENTAL DESIGNS 


A Variety of labels have been applied to methods that permit a systematic 
and quantified observation of changes in an individual—‘“‘intensive de- 
Signs,” “multiple baseline methods,” “same subject research,” “N-1,” “in- 
terrupted time series,” “empirical case studies’’—but here these methods 
Will all be referred to as intensive experimental designs. These methods all 
share the underlying assumption that human beings change continuously 
and that one must observe change as a process rather than as a single 
Movement from pretreatment (before the counseling intervention) to post- 
treatment (after the intervention). That is to say, a single observation before 
treatment compared to a single observation after treatment can lead to an 
erroneous conclusion about treatment effects. A single observation, whether 
It is a test score, a count of specific behaviors, OF the client's self report, may 
ell Us what is happening at a given moment but does not give us any 
'nformation about the direction in which the client is changing. Again we 
are faced with the problem of individual variation, and a single point esti- 
Mate may be misleading. For example, suppose à colleague of pen 
Ported the following evaluation of the effects of group counseling in working 


an extremely shy fifth grade girl 


with other kids before or after school or 


before the group began, | had the play- 
8tound monitor count the number of times she was interacting with another i 
Child, The monitor recorded three interactions during recess. After the Ber 
ing 8roup, | had the monitor count again and this time Mary interacted nine 
Imes with other kids. So I knew the group was effective for her. 


S 
ne almost never talked or played \ 
ring recess. So on the Wednesday 
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Most of us would be persuaded by such information that the counsel- 
ing group indeed had produced a change. But Figure 4-1 shows what the 
counselor would have seen if the playground monitor had been observing 
Mary each day. As we can see, the frequency of social interactions is already 
increasing before counseling. Thus, counseling cannot be said to have 
brought about this upward trend despite the fact that the comparison of two 
points (day 2 compared to day 12) shows a “significant” change. 

Not only might we mistakenly conclude that counseling had produced 
a change when it had not, we might also mistakenly conclude that counsel- 
ing was not effective when in fact it was. In the case represented in Figure 
4-2, we can see that simply comparing the observations on day 3 (before 
treatment) and day 11 (after treatment) would lead us to conclude that 
counseling had no effect. Obviously, counseling had a dramatic effect in 
changing the trend or direction of change. 

The preceding examples highlight the fundamental principle underly- 
ing intensive experimental research methods. 


Principle 1: An empirical study of a single subject requires that the 
counselor/researcher make a series of observations over some period of time in 
order to determine both the degree and direction of change. 


10 Group 
meeting 


9 | 
| 


Frequency of interactions 


Days 
FIGURE 4.1 Client Change Not Necessarily Due to Group Counseling. 


STUDYING INDIVIDUAL CHANGE 123 


a œ 
Poi 


o 
T 


> 


Frequency of interactions 
a 
m 


w 


Days 
ably Due to Group Counseling. 


FIGURE 4.2 Client Change Pro 


s referred to as a time series and relies on a 


second major assumption—that the observations in a time series reflect a 
Continuous process of change. For example, if we observed a client on 
Monday, Wednesday, and Friday, we know that the process of change is 
Occurring on Tuesday and Thursday even though we have not observed it. 

Onsequently, we must estimate the “real” process of change, since we 
ave only observed part of it. This assumption leads us to a general principle 


Ör Usina t ae 
"using time series to study an individual. 


A set of such observations i 


he continuous process of change, observations 


Principle 2: In order to estimate t S N 
tinuous and frequent as possible. 


in a time series should be as con 


Wi 

hat to Observe 

ental research have come from 
| approach. Because the behavioral coun- 
blem in terms that can be observed with 
and Thoresen, 1969), this type of 


Mo : : 
St applications of intensive experim 


bs : ^ 
set Ologists utilizing a behaviora 
‘Sion is likely to define a client's pro 

© frequency over time (Krumboltz 
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research can be more readily applied. The application of this research 
method does not require the counselor to utilize a behavioral approach to 
counseling, but it does require that the counselor be able to express objec- 
tives and relevant variables in observable terms (to “operationalize” them) 
in order to monitor them over a period of time. 

Traditional counseling research has relied heavily on standardized tests 
and other forms of psychometric assessment. These methods are inappro- 
priate for our purposes for four reasons. First, these methods attempt to assess 
unobservable qualities or characteristics such as dependency, anxiety, Or 
self-concept. Second, they are designed to assess individual performance 
only as relative to group performance. For example, an individual score on 
the D (Depression) subscale of the MMPI does not assess the individual’s 
actual feelings of depression, but describes the individual’s responses to the 
test items in terms of “group norms.” Consequently, if we are interested in 
changes within a group, these measurement techniques are appropriate. 
However, they tell us little about an individual. 

Third, this type of instrument cannot be administered repeatedly to the 
same individual unless alternate forms are used. Since most psychological 
tests have only one or two forms, they cannot be used to assess the same 
client repeatedly over time. Fourth, and most important, this type of assess- 
ment frequently assumes that individuals possess certain personality “traits 
that are stable across situations. For example, the assumption is that an 
aggressive child is aggressive on the playground, in the classroom, at home, 
at church, and at a baseball game. However, most human behavior is not so 
consistent (Mischel, 1973). An individual may be relaxed and talkative 
around close friends and yet tense and quiet at a staff meeting. The attempt 
to assess stable personality traits has obscured the interaction between the 
individual's behavior and environmental characteristics. , 

A major obstacle in conducting intensive experimental research is tre- 
quently the counselor's attitude toward observation and measurement. One 
often hears counselors say something like, “All right, you can count the 
number of times the kid gets out of his seat without asking permission, but 
you can’t count something really important like his self-concept.” It is true 
that we cannot make an actual assessment of such constructs as self- 
concept, independence, and mental health, but we can assess related ob- 
servable variables and use them as an index of progress. This procedure I$ 
similar to a physician's monitoring such variables as a patient's blood pres- 
sure, heart rate, respiration, and temperature as an index of the construct ot 
the patient's “health.” Unfortunately, the relevant observable indexes of 
“psychological health,” “personal growth,” or “healthy development” 
have not been established. Consequently, the couselor/researcher must 
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His “self-concept score” was the percent of the maximum number of 
points. During the course of ten sessions a graph of his self-concept scores 
was plotted (Figure 4-4). In addition, the scores were analyzed separately for 
areas of self-concept involving parents, schools, siblings, and peers. This 
type of data analysis not only allows the counselor to monitor the overall 
effectiveness of counseling, but provides ongoing information that can be 
used in the process of counseling. . 

Another approach to operationalizing the construct of self-concept Is 
presented by Hannam, Thoresen, and Hubbard (1974) in an attempt to 
increase the self-esteem of teachers. They operationalize the construct as 
follows: 


A positive self-concept was defined as a high frequency of positive (reinforcing) 
self-evaluations combined with a low frequency of negative (punishing) self- 
evaluations; a negative self-concept was viewed as the converse, that is, 4 
many negative evaluations and few positive ones. (p. 146) 


After an initial interview where self-thoughts were defined and a list of 
common self-thoughts was generated, each teacher was asked to self ob- 
serve positive and negative thoughts about self during a specified hour each 
day. The teacher recorded each self-observation on one of two wrist Coun- 
ters. An example of a positive self-thought was “I am patient with children. 
A negative self-thought may have been “I’m wasting my time here, | should 
be doing something more important.” Figure 4-5 shows how this index of 
self-concept was used to monitor changes in three teachers over time. Dur- 
ing the baseline phase, the teachers were asked to observe and record both 
positive and negative self-thoughts. In the next phase, teachers learned to 
subvocalize the word stop and imagine a stop sign immediately following 
the occurrence of a negative thought. Teacher number 3 did not participate 
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FIGURE 4.4 Index of “Self-Concept” Plotted Over Ten Counseling Sessions. (From 
How To Do Psychotherapy and How To Evaluate It By John M. Gottman and Sandra 
R. Leiblum. Copyright © 1974 by Holt, Rinehart and Winston, Inc. Reprinted by 
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in this procedure but continued the baseline phase. The third phase, for all 
three teachers, was designed to increase positive thoughts by placing “eues” 
(e.g., a blue decal on the clock) in order to prompt the teacher to think a 
positive thought while engaging in routine actions. 

Although the preceding examples use very different methods to 
operationalize the construct “self-concept,” they illustrate two important 
points. First, ‘‘unmeasureable” constructs can be operationalized to provide 
useful data to monitor change over time. To be useful, the selection of what 
is observed is tailored to the individual client or problem under investiga- 
tion. This does not mean that the counselor/researcher must “re-invent the 
wheel” every time, but learns and revises observation strategies based on 
experiences with different clients. Second, there is no “right answer” OF 
perfect solution to the question of what to observe. Not only are there an 
infinite number of solutions, but deciding what to observe is a continuous 
process rather than a single decision. Unfortunately, this part of the process 
is often left out of research reports, and it appears that the investigator came 
up with the solution with practically no effort. This is usually not the cas€ 
and especially so for the counselor just beginning to observe or have clients 
self observe specific actions. This process is sometimes difficult but there isa 
growing number of resources and models to which the counselor can turn. A 
variety of systems have been developed for observing teacher behavior and 
classroom interactions (Medley and Mitzel, 1963; Flanders, 1970). Exam- 
ples of operationally defining constructs related to individual counseling can 
be found in Risley and Wolf (1972), Dustin and George (1973), Rimm and 
Masters (1975), and Krumboltz and Thoresen (1976). Thoresen an 
Mahoney (1974) have described various methods of self-observation that 
make “private events” available for investigation. In addition, Liberman 
(1970, 1972) and Krumboltz and Potter (1973) suggest ways of 
operationalizing such concepts as cohesiveness, trust, empathy, and inti- 
macy, which are frequently considered important in group counseling. It is 
then possible to study the group as a “single subject” and monitor the 
development of “cohesiveness” over time. 


Technical Considerations 


There are several important criteria that influence how well or how poorly 
we are able to make appropriate conclusions from the results of an experi- 
mental design, whether it is a comparative group design or a correlationd 
study or an intensive experimental design. Since these concepts are discus- 
sed in detail elsewhere, the discussion here is brief and limited to their 
application to intensive experimental designs. 
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VALIDITY. How do you determine if you measured or observed what you 
actually intended to? Although this is frequently a significant problem in 
povchometrie assessment, it is less so in intensive experimental research 
ecause we are more likely to be observing the actual actions or characteris- 
tics of an individual and not inferring them from a test score. The problems 
of validity within an intensive experimental design are faced when you 
begin to answer the question “what to observe” as discussed above. 


RELIABILITY. How accurate are the measurements Or observations? Often 
the answer to this question appears to be simple when it is not. Many factors 
can affect the accuracy of such “simple” actions as seeing and counting. In 
general, the counselor/researcher can increase the accuracy of observation 
by careful and detailed attention to the following four factors. 


no substitute for a detailed, 

get behavior. It is theonly way 
t and what not to count. For 
hild’s disruptive behavior, we 
t the number of times the 


1. What is being observed. There is 
well-defined description of the tar 
the observer knows what to coun 
example, if we are interested in a C 


could simply ask the teacher to coun 
child is disruptive in class. However, we would have no way of 


knowing if “disruptive” had the same meaning for the teacher as 
it did for us. By defining disruptive as any occasion when a — 
child’s behavior requires direct attention trom the teacher that is 
not related to the ongoing classroom activities, We have 
increased the likelihood that the teacher will make more 
accurate observations. We could increase the reliability still 
further by describing the specific act that would be considered 
disruptive, for example, yelling, swearing, pounding on desk, 


dropping books, Or slamming the door. 


2. Where and when the behavior is observed. We can further 
increase the accuracy of observations by specifying the 
conditions for those observations. If we ask the teacher in the 
preceding example to observe the child in the classroom, during 
reading, for 45 minutes 4 day, we are likely to get more reliable 

observations than if the teacher observed “only when | thought 


about it.” 
3. How the observations are counted. The procedures for counting 
should be specified and should make 


and recording observations 
the act of recording as easy as possible. For example, instead of 
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having a teacher record every instance of disruptive behavior, 
which might be difficult to do while carrying out the normal 
activities of teaching, we could ask the teacher totake a moment 
at the end of each hour and simply check whether or not the 
disruptive behavior had occurred. This “time sampling” 
procedure would increase the consistency of the teacher's 
observations. 


4. Who the observer is. Numerous characteristics of the individual 
doing the observation as well as that person’s interaction with 
the conditions under which the observations are made influence 
the reliability of the observations. The usual procedure for 
checking the observer's reliability is to have two or more 
individuals observe the same things under the same conditions at 
the same time, and then compute their “agreement.” Often as 
counselors we are interested in thoughts, feelings, and images 
that take place within an individual and cannot be observed by 
someone else. In such cases, we must have the client observe 
him/herself. There are several distinct advantages to 
self-observation, and the factors affecting one’s ability to 
accurately monitor one’s own behavior are only beginning to be 
explored (Kazdin, 1974; Thoresen and Mahoney, 1974). 


UTILITY. The final and often ignored characteristic of measurement is the 
ratio between the cost of obtaining the information and the benefit derived 
from the information. For example, if | were interested in increasing 4 
client’s personal responsibility during counseling sessions, | could tape re- 
cord each session and do a content analysis to find out how many “‘respon- 
sibility taking” statements the client made. Such a procedure might produce 
very reliable and valid data but it is not practical for the practicing counselor 
without a large research budget. Fortunately, there are several inexpensive 
and often useful data sources. Since the cheapest kind of data is data already 
collected, the counselor/researcher should not overlook records that are 
routinely kept by schools, agencies, or institutions. 


Designing an Intensive Experimental Study 


The most important factor in determining how to design a particular study is 
the answer to the question “What do | want to know?” That may soun 
simplistic, but only by answering that question carefully can the 
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Counselor/researcher determine what factors are important in the design of a 
study. No textbook can tell you how to design the study you want to do. The 
process of experimental design is not one of following rules generated by 
some authority, but rather the diligent application of logic and common 
sense (Anton, in press). 

The major purpose of an “experimental” research design is to explore 
Cause and effect relationships but it is essential to keep one fundamental 
Principle in mind when designing and interpreting such studies. We can 
Never design an experiment or set of experiments that prove a causal rela- 
tionship exists. For any experimental finding there are always alternative 
explanations. The value of any single type of design is relative to the number 
and types of alternative explanations it eliminates. For example, if a coun- 
selor used assertive training procedures with several married couples with 
€qual success in improving their relationship, we have some evidence that 
those procedures may be related to improving marital relationships. How- 
Ever, itis just as likely that the improvement was “caused” by some charac- 
teristics of the particular counselor involved and not related to the proce- 
dures per se, The only way to rule out one or the other of these rival 
hypotheses would be an experiment using the same procedures and differ- 
€nt counselors. 

No experimental design is 


The merits of any particular design can ! l 
Questions under investigation. The following section provi 


of basic designs used in intensive experimental research. 


“good” or “bad” in any absolute sense. 
be evaluated only in terms of the 
des a description 


ANNOTATED TIME SERIES. The most elementary level of investigating 


Causal relationships is to examine the fluctuations in a series of observations 
and begin to pinpoint variables that covary with these fluctuations. For 
example, in working with a 45-year-old depressed woman, | was interested 
2 €xamining those factors that covaried with shifts in her depressed mood. 
ne kept daily records of her mood by completing the Depression Adjec- 
tive Check List (DACL) (Lubin, 1965) and kept a daily diary of “significant 
events,” Figure 4-6 presents the series of DACL scores that has been anno- 
fated with references to specific significant events that occurrred on the 
Same days. 


th An examination of this chart reve 
se on days 5, 16, and 23 are follow r 
SPression; whereas pleasant events, such as those on days 13 and 21, 
Seemed to have an immediate but temporary effect on alleviating the client's 
Mood, Further the type of unpleasant experience that increased the depres- 
“On was a conflict with another person. As a result of discussing the chart, 


aled that unpleasant events such as 
ed by three or four days of acute 
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FIGURE 4.6 Annotated Time Series of Depression Adjective Checklist Standard 
Scores and Significant Events. 


we set the following objectives that seemed likely to reduce the client's 
depression: to learn skills to manage interpersonal conflict, to decrease the 
time spent “worrying” about conflicts with others, and to increase the 
number of pleasant activities in which the client engaged. f 
Although Figure 4-6 presents what seem to be obvious relationships 
between significant events and changes in mood, it was only after carefu 
examination and some “detective” work that the specific events presente 
were isolated. By looking carefully at events both preceding and following 4 
shift in the time series, the counselor can begin to generate hypotheses 
Frequently, the most “significant” events are not the most obvious, an 
considerable persistence and creativity may be required. An example © 
how such apparently unrelated events can be of importance is illustrated by 


Edwards and Cronbach’s (1952) discussion of Fisher's (1921) analysis of 
wheat yields. 


[Fisher] found that after he controlled variety, and fertilizer, there was consider 
able variation from year to year. This variation had a slow up and down cycle 
over a 70 year period. Now Fisher set himself on the trail of the residual vat! 
tion. First he studied records from other sections to see if they had the trend; they 
did not. He considered and ruled out rainfall as an explanation. Then he start® 
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reading the records of the plots and found weeds as a possible factor. He 
considered the nature of each species of weed and found that the response of 
specific weed varieties to rainfall and cultivation accounted for much of the 
cycle. But the large trends were not explained until he showed that the upsurge 
of weeds after 1875 coincided with a School Attendance Act which removed 
cheap labor from the fields, and that another cycle coincided with the retire- 
ment of a superintendent who made weed removal his personal concern. (p. 64) 


Another method of searching for concomitant variation is to examine 
two sets of observations at once and look for parallel fluctuations. This 
method is illustrated in Figure 4-7, which represents a set of ar 
observations made by a graduate student in counseling as part of a self- 
change project. 
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after going to bed and the frequen 
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The annotated time series design is most often useful as an exploratory 
or first order examination of causal relationships; it is also useful in program 
evaluation to monitor changes over time in order to confirm or disconfirm 
the effects of specific events. For example, teachers in a program for poten- 
tial high school dropouts assumed they had made major breakthroughs as a 
result of a long, emotional, intimate talk with a student. Such talks occurred 
with three different students. A time series analysis, however, questioned the 
conclusion that these talks produced beneficial effects. The analysis showed 
that following the talk each of the students significantly avoided the teacher, 
did not improve in academic performance, and significantly increased 
classroom disruptive behavior (Gottman, 1971). 


INTERRUPTED TIME SERIES OR AB DESIGNS. The basic problem of Er 
perimental design is how to rule out alternative explanations for specific 
effects. Because no single experimental design, whether comparative group 
or intensive, can rule out all alternatives except one, experimentation shoul 
be viewed as a process rather than a specific “experiment.” Several basic 
design options for intensive experimental research are described in the fol- 
lowing section. Each of these design options involves somehow “interrupt 
ing” a time series of observations. The following notation is used to desig- 
nate different phases or periods of the time series: 


A Baseline phase (before treatment) 
B First treatment use 
C Second treatment phase 


D Third treatment phase 


A’ Return to baseline phase (after treatment) 


The AB Design. 


The simplest of the intensive designs is the AB design where a series of 
baseline observations (A) are compared to a series of treatment observations 
(B). The A phase serves as the “control” phase—that is, we can use this 
phase to estimate what would happen without treatment. Consequently, this 
design allows us to rule out the possibility that the observed changes are 2 
result of pretreatment trends as illustrated in Figure 4-1. A major weakness o 
this design is that it fails to control for the effects of history, that is, other 


STUDYING INDIVIDUAL CHANGE 135 


rine an at the same time as treatment that could account for the 
er or ee widespread media coverage of a construction worker 
I nn a the 23rd floor of a building would present problems if it occur- 
dient ultaneously with the onset of a treatment for acrophobia for one’s 
In addition, the re 
other individuals with confidence. Howev 
distinction between intensive experimental research and the use of com- 
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ee ls Generalization within an intensive experimental method is 
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ame client each time a technique is used (intraindividual replication) or 
2 mir clients (interindividual replication), then confidence is increased 
ken the counseling procedure is effective. In this way, the question of 
P biti can gradually be answered—that is, whether the counseling 
nique works with different clients, different counselors, and different 
Problems. 
RL: major advantage of the AB design is tha 
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An example of the ABAB design is presented in Figure 4-8. In this study 
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FIGURE 4.8 ABAB Design Investigating the Effects of Teacher Nonverbal Approval. 
(From Kazdin and Klock, 1973.) 


(Kazdin and Klock, 1973) the effect of teacher praise on the attending be- 
havior of retarded children in a special education classroom was examined. 
After the baseline observations were made, the teacher was instructed to 
increase her use of nonverbal approval to the students by smiling, physically 
patting them on the back, and nodding approvingly for paying attention to 
her. During this phase, the students’ attentive behavior increased. The 
teacher was then instructed to discontinue the use of nonverbal approval 
and the students’ behavior “returned to baseline.” The treatment procedures 
were then reinstated and again the students’ behavior increased. 

The ABAB design is the most powerful design for demonstrating ca ‘ 
relationships, especially if replicated with different subjects and differen 
situations, yet there are several factors that limit its utility. First, it May be 
impossible to remove or reverse the effects of treatment. For example, learn“ 
ing a new skill, such as how to respond empathically, cannot be “turn 
off” since the person has acquired a new response. A variety of responses 
once learned cannot be unlearned (Bandura, 1969). Second, while a par- 
ticular behavior may be “reversible,” the treatment procedures may have 
changed the subject and/or others in the environment. Once a teacher learns 


usal 
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that the use of "I-messages” decreases disruptive behavior in class, she or he 
may be unlikely to terminate the use of such statements even if consciously 
intending to. Third, the removal of treatment procedures may be highly 
undesirable or unethical. For example, if a treatment is successful in 
eliminating the self-injurious behavior of a child, the risks associated with 
withdrawing that treatment are not justified in order to establish experimen- 
tal control over the behavior. Fourth, it is usually the task of the counselor to 
establish relatively permanent changes in behavior rather than transitory or 
highly “reversible” ones. Consequently, the maintenance of behavior 
change is more important than the establishment of causal relationships. 


ntioned previously, a major 
lure to control for the effects 
g for these events is the use 
design (Gottman, McFall, 


MULTIPLE TIME SERIES DESIGNS. As me 
Weakness of a single time series design is its fai 
of concurrent events. One method of controllin 
of two or more subjects, or multiple time series 
and Barnett, 1969). One of the subjects is randomly assigned to the treat- 
ment while the other serves as a control subject. Once the treatment effect 
a been established, the treatment can then be applied to the control 
subject. A study by Hall, et al. (1970) illustrates this design (see Figure 4-9). 
Three tenth grade students who had been earning D or F grades on 
Class quizzes were selected. Baseline data was collected on each student. 
The treatment, which consisted of required tutoring contingent upon Dor F 
8rades, was applied on the tenth day to Dave. Five days later, after observing 
the increase in Dave’s grades, the treatment was applied to Roy. Now Roy’s 
Brades increased after the beginning of his tutoring. Finally, five days later, 
the procedures were applied to Debbie, and the same effect was demon- 
strated, Because the increase in grade was observed for each student only 
after that student’s tutoring began, we can be more confident that the treat- 
ment, rather than some other simultaneous event, produced the change. 
his “time-lagged’’ design has several advantages. First, such a design meets 
all the criteria for the internal validity of an experiment (Campbell and 
Stanley, 1966). Second, it avoids any ethical problems associated with per- 
manently withholding treatment from a subject. Third, it provides the oppor- 


tuni A 4 
nity for immediate replication of results. 


Another major design option involves 

dividual. The two major types of multi- 

ble baseline designs are: (1) across situations, where the same behavior is 

die in different situations; (2) across behaviors, where two or more 
erent behaviors are observed in the same situation. 


MULTIPLE BASELINE DESIGNS. 
tiple observations on the same in 
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FIGURE 4.9 Time Lagged Multiple Time Series Design. (From R. V. Hall, C. Cristler, 
S. Cranston, and B. Tucker, Teachers and parents as researchers using multiple 
baseline designs. Journal of Applied Behavior Analysis, 1970, 3, 247-55. Reprinted 
by permission of the Journal of Applied Behavior Analysis, Department of Human 
Development, University of Kansas, Lawrence.) 


Across Situations. 


Figure 4-10 is an example of a multiple baseline design across situa- 
tions. In this study (Schmidt, 1974) a fourth grade boy’s aggressive responses 
(e.g., biting, kicking, spitting) were observed during both Reading and Math 
classes. The treatment intervention consisted of having the teacher respon 
to the aggressive behavior with an “I message” (e.g., “I’m scared to deat 
that you will hurt someone seriously when you kick.”) The treatment wa? 
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tions in this type of design are not necessarily two specific places, but rather 
two sets of stimulus conditions that share some important characteristic. For 
example, in studying the effects of assertive training you could observe 
assertive behavior in response to men and women, strangers and friends, 
supervisors and those supervised, and so on. By repeatedly exämining dif- 
ferent situational or stimulus properties, the most relevant variables affecting 
the phenomenon should emerge. 


Across Behaviors. 


This design involves repeated observations on two or more behaviors 
followed by the application of treatment procedures to one behavior at a 
time. It has often been used to evaluate the effects of reinforcement contin- 
gencies (Schwarz and Hawkins, 1970; Risley and Hart, 1968; Hall, et aly 
1970). In such studies two or more target behaviors are selected that are 
assumed to be independent of each other. For example, a female college 
student wanted to increase her frequency of social interaction and to de- 
crease the amount of time she “procrastinated” during study periods. Both 
of these behaviors were monitored continuously. The treatment intervention 
consisted of a “self-contract’’ (Thoresen and Mahoney, 1974) where the 
client established her own goals (e.g., to initiate a conversation with another 
person at least three times a day) and then reinforced herself (e.g., buying a 
new plant) if she attained the goal. After the self-contracting was established 
as effective in increasing the frequency of social interactions, the client then 
applied the same procedures in order to decrease the amount of time spent 
procrastinating. This type of multiple baseline design is very useful for dem- 
onstrating the effects of contingency arrangements when the behaviors are 
assumed to be functionally independent and it is also useful in examining 
the components of complex social skills. Hersen and Bellack (1976) uS® 
the multiple baseline design to examine the components of assertive be- 
havior with a chronic schizophrenic. Figure 4-11 presents observations © 
four specific behaviors viewed as components of assertiveness for the PA 
ticular subject involved. The same treatment, consisting of giving the client 
instructions and feedback on a target behavior during videotape “probe 
sessions, was sequentially applied to each of the four behaviors. First, the 
client was given feedback on and instruction for increasing the amount © 
eye contact while talking; then for increasing the duration of speaking, then 
for increasing the number of requests made, and finally, for decreasing 
compliances. Throughout the study, the client’s overall assertiveness wae 
assessed as well as the frequency of each target behavior (Figure 4-11). This 
design demonstrates that the treatment procedures were effective in chang- 
ing each of the target behaviors and additionally illustrates the cumulative 
effect of each change on the client’s overall assertiveness. 
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COMBINATION DESIGNS. The preceding section has presented some of the 
basic design options in intensive experimental research. However, there are 
infinite possibilities for combining and adding to any specific design. Again, 
the design you use or create depends on what questions you are asking and 
what kinds of alternative explanations you wish to investigate. For example, 
you may begin by evaluating the effects of a specific treatment with an AB 
design. You may also be interested in the effects of an additional treatment, 
C. This raises the additional question of ‘Does it make any difference which 
treatment comes first?” In addition, you might want to control for concurrent 
events by using control subjects. In any case, the possibilities are limitless. 


Analysis of Results 


Careful and detailed analysis is critical when analyzing the results of an 
intervention using an intensive design: first, because a time series can 
change in a variety of ways as a result of an intervention, and second, 
because changes in a time series may be only in the “eye of the beholder.” 

A time series of observations has two important dimensions, either of 
which may change as a result of an interaction—a certain level of magnitude 
and a trend or slope in the direction in which it is moving. Figure 4-12 
illustrates different types of changes that can occur as a result of an interven- 
tion. 

In determining the level and slope of a time series, it is most tempting tO 
say, ‘Well, | can tell how things are going just by looking at it.” Sometimes 
you can, but frequently you may be deceived. Consider the following case- 
A counselor was working with a client who wanted to decrease the number 
of nonassertive responses he made at work. The counselor had the client 
observe and record the number of nonassertive statements he made each 
day. After 10 days, the counselor wanted to determine if the client was 
improving just by observing his behavior. The client’s observations were 
recorded on a chart (Figure 4-13) to assess changes in the trend over time- 
Most people estimate that the trend is going downward and, consequently, 
that the client is changing as desired. However, if you cover up points 2 an 
7 (the highest and lowest points), the trend looks flat. Extremely high or low 
points tend to mislead us visually when we examine a chart. 

Several procedures exist for analyzing the trend in time series data, but 
the simplest and most useful for the counselor/researcher is the split-Middle 
method (White, 1972). If you follow the simple steps presented below you 
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10 


Number of nonassertive 
statements 
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0 


FIGURE 4.13 How Is the Client Changing? 


Your data should be plotted on a semi-log chart where the 
vertical axis is in a logarithmic scale and the horizontal is 
represented in equal intervals (e.g., days). This type of chart _ 
“transforms” your data and tends to reduce the variability in it 
from day to day. The objective is to represent the data by a 
straight line, primarily because a straight line can be readily 
understood and used. 


Draw a line on the chart so that you have divided the data oa 
in half (see the broken line in Figure 4-14a). If you have an © 
number of points, your line will run through the middle point. 


Draw a line through the middle point in each half (solid = 
vertical lines in Figure 4-14a). If you have an even number ©! 
points, this line will fall between two points. 


Draw a line through the middle rate, that is, the point with an 
equal number of points above and below it (heavy horizontal | 
lines in Figure 4-14b). Frequently, there will be more than ei 
point on the middle rate line. Simply draw the lines through al 
the points at the middle rate. 


Draw a line through the intersections of the middle point and a 
middle rate lines in each half (diagonal line in Figure 4-14c). This 
is called the slope or line of progress. 


Check to see if the line “splits the data in half” (i.e., are there an 
equal number of points above and below the line?). In this case 
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Once you have drawn the line of progress, you can determine the slope 
or rate of progress to determine how fast it is going up or down. This can 
help you predict how long it will take the client to achieve a specific objec- 
tive. You can compute the slope with the following method. 


iL Pick a day and note the rate of the line for that day. For example, 
if you pick the first day on Figure 4-14c, the point on the line of 
progress for that day (not the actual data point) is 7.5. 


2, Count off 7 days into the future and note the rate of the line of 
progress at that point. In the example, it would be the eighth day 
and the rate is 4.5 (see Figure 4-14c). 


3; Divide larger number by the smaller—in this case, divide 7.5 by 
4.5. The quotient is 1.67. 


4. If the line is going down, label the slope + (divide). In this case, 
the slope is + 1.67. This means that every week, the data are 
decreasing by a factor of 1.67 (about a 67 percent reduction 
every 7 days). If the line is going up, label the slope x (times), 
which indicates that the rate is multiplying (i.e., increasing by 4 
certain rate, such as X 2.0). 


After you have computed the slope, you will want to know if it 1$ 
significantly different from zero (i.e., is the line actually different from a flat 
line?). What are the chances of finding a slope that is different from 4 
horizontal slope? You can do this by using Fisher's Exact Probability Test 
(Siegel, 1956). As a “rule of thumb,” you can be pretty sure that a slope Of 
less than 1.25 is probably not different from a flat line. Whether a slope 
greater than 1.25 will be significant depends upon a probability viewpoint 
on variability—that is, how “scattered” the data points are around the line- 
of-progress. You can also test the differences between two slopes (€-8- 
before and after counseling) by using the binomial test (Siegel, 1956). Other 
methods for analyzing this kind of data, often referred to as time series 
analysis, are available (see Gottman and Leiblum, 1973). 


CONCLUSIONS 


Because counseling is primarily concerned with the growth and change of 
individuals, this chapter has considered methods for the systematic wean 
an individual. The integration of counseling research and practice has at- 


STUDYING INDIVIDUAL CHANGE 147 


ways been desirable, but it has been much more illusion than reality. A 
Major reason for this discrepancy is inherent in our limited view of what 
Constitutes ‘‘acceptable”’ research methodology. By relying on designs that 
Compare one group of subjects to another, the effects of a counseling or 


training procedure on individual subjects are lost. 
Through the use of both qualitative and quantitative methods, coun- 


selors can learn more about how the individuals are changing and the 
factors that influence that change. Intensive case studies can help counselors 
Understand unique cases, disconfirm prevailing theories, and generate 
“hunches” about cause and effect relationships. 

Quantitative methods that involve a series of observations over time 
can be used to study cause and effect relationships between counseling 
Interventions and individual change. By using different design features such 
as baseline, multiple baselines, multiple subjects, and time-lagged interven- 
tions, counselors can investigate questions of causality, generalization, and 
replication. The variety of intensive experimental designs allow the 
Counselor/researcher to design an investigation to answer the particular 
Question of interest rather than choose a question to fit a preselected design. 

Research, like counseling, is a process. Specific techniques, theories, 
and methods are useful in both counseling and research but learning to be 
effective at either requires practice and experimentation. However, both 
Counseling practice and research involve “seeing” and understanding 
clients more clearly. Consequently, by improving your ability to study indi- 
Vidual change, you will also improve your ability to counsel effectively. 
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CHAPTER 5 
Participant Observation— 


Rediscovering 
a Research Method 


Richard M. Balaban* 


Participant observation is a valuable research method for attaining an inti- 
mate, close-up view of individuals, groups, and settings. Participant observa- 
tion enables counselors to study a wide range of research and evaluation 
problems by observing people's actual behaviors and interactions with key 


persons in important settings- 


Although participant observation produced a number of seminal works 


in the 1930s and 1940s, psychology’s premature push for scientific re- 
Spectability elevated the experiment to center stage and excluded the more 
qualitative approaches such as participant observation. Only recently have 
Counselors and mental health professionals “discovered” participant obser- 
vation, a method long found useful by sociologists and anthropologists. 
This “new” method for counselors has two interdependent aspects. 
The “participant” aspect requires the researcher's involvement in the setting 
to gather data about a particular individual, group, OF entire social system; 
the “observer” aspect of this method requires the researcher to record ob- 
servations conscientiously. The participant aspect thus relates to the 
researcher's presence and active involvement as a doer in a setting and the 
Observer aspect to the functions as a researcher (Schwartz and Schwartz, 


1955) 
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Participant observation may require the researcher to enact various 
research and evaluation roles and tap numerous data sources (McCall and 
Simmons, 1969). The most common research role for a participant observer 
is that of “participant-as-observer’’ (Gold, 1958; Junker, 1960) who informs 
the subjects of the research aims. For example, a college counselor inves- 
tigating the socialization aspects of being a student may spend a good deal 
of time in the student union, classes, and informal student interviews 
(Becker, et al., 1961; Merton, et al., 1957). The counselor may thereby learn 
about longitudinal development and change in student values, attitudes, and 
social interactions. The participant observer may also be a “complete par- 
ticipant’’ (Gold, 1958; Junker, 1960), an actual member of a system who 
conceals the research aims from those being studied. A counselor, for in- 
stance, may evaluate a rehabilitation program in a state hospital by enrolling 
as a “client” to gather direct information about program impact. The coun- 
selor may thereby reduce the likelihood of staff altering their behavior or 
routines (Rosenhan, 1973). As a complete participant one can learn about 
the effect of the program on one’s own functioning and those of the patients 
and can experience directly the staff's attitudes, skills, and relations with 
patients. The complete participant role also enables a counselor to study 
groups that may generally bar outsiders because of their illegal or intimate 
activities (Riecken, 1956; Riesman and Watson, 1964). 

Participant observers generate data from observations, interviews and 
notes on behaviors, thoughts, and activities in ongoing social settings. The 
researcher's active involvement in a setting is a key element of data- 
gathering in participant observation. Such researchers gather data from ob- 
servations about the behavior of others and themselves. For example, an 
employment counselor may go through the hiring process to better under- 
stand and document employer-applicant interaction. The employment 
counselor may learn the difficulties clients face in getting jobs. If the par- 
ticipant observation data showed that clients performed poorly during the 
interviews, the counselor may revise any training or counseling program to 
include more client preparation for the job interview situation. 

Counselors’ introspection of their own thoughts and feelings is useful 
as data in evaluating service-providing settings (Balaban, 1973). For exam- 
ple, a counselor may better assess the quality of service rendered at a com- 
munity mental health center by posing as a client. The counselor can report 
how she or he felt about the initial telephone contact, the amount of time 
waiting for the first appointment, the atmosphere in the center, and the 
understanding and concern of the community mental health center staff. 

The participant observer may also interview respondents about their 
views and behaviors. The college counselor mentioned previously could ask 
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students about changes in their self-concepts based on their socialization 
experiences. Finally, the participant observer may also develop working 
relationships with informants who are experienced and knowledgeable 
about a particular setting. Thus, a counselor in a prison may cultivate data- 
gathering relationships with articulate and perceptive guards and inmates in 
order to learn more about prison life. The guards may describe the demands 
of their job, their views of the inmates, and their relationships with inmates 
and other guards. The inmates may discuss their feelings about imprison- 
ment, relationships with other inmates and guards, and their separation from 
family and friends. 
This chapter presents the methodology of participant observation—the 
research and evaluation processes and limits of the participant observer's 
entry, involvement, and data-gathering. The applicability of participant ob- 
servation to counselors’ research and evaluation activities in a number of 
different settings, such as schools, community mental health centers, state 
hospitals, prisons, and drug treatment programs is demonstrated. Also illus- 
trated is how participant observation can gather valuable data to help coun- 
selors better understand and evaluate: (1) client problems in a group and 
systems context; and (2) the stress and supports experienced by other 
care-givers and the counselor's relationship to these care-givers. 


THE METHODOLOGY OF 
PARTICIPANT OBSERVATION 


ant observation entails a number of issues that 


The methodology of particip 
as well as its data. Counselors 


shape the research and evaluation process, 
will find the following participant observer areas relevant to their own re- 


search and evaluation activities: (1) entry into the setting; (2) involvement in 
the setting; (3) method of gathering data; and (4) response to potential limits 


of the method. 


The Participant Observer's Entry into the Setting 


a number of problems during the entry 
Process. The researcher's data-gathering efforts depend on permission to 
conduct and continue research, adaptation to people's suspicions, and ac- 


Ceptance for the ongoing research activities. 
Participant observers generally require the permission of leaders in the 
research site to conduct their research and evaluation activities. These 


“gate-keepers’’ often determine whether a participant observer will be al- 


The participant observer encounters 
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lowed to accomplish the intended work and, therefore, the participant ob- 
server must gain their support. 

Even with the leader’s sanction, the participant observer’s entry may 
arouse suspicion and anxiety (Dollard, 1937, Wax, 1960). If a counselor is 
doing research in an institutional setting, the owners or directors must sanc- 
tion the study. As a result, the staff and clients may suspect that the coun- 
selor is an agent of management and will “check up” on them (Blau, 1964). 
The staff may be especially anxious about the results of the study if the 
director introduces the researcher as a program evaluator. Just as those 
evaluated may feel anxious, participant observers also experience a degree 
of uncertainty and discomfort during the development of new relationships 
(Powdermaker, 1966). 

The researcher may also feel discouraged by the limited amount of data 
collected in the early stages of the study (Blau, 1964; Wax, 1960). The 
participant observer's discouragement with the data and relationships with 
people stem, in part, from often being in a vulnerable position. The partic- 
ipant observer generally enters an ongoing social system of which he/she is 
not a part only to face suspicion and hostility alone. The researcher must 
learn to overcome an insecurity that can accompany even a friendly accep- 
tance in the setting (Powdermaker, 1966). Most participant observers are 
subject to the fear and vulnerability of an untimely termination of their study 
by leaders in the setting. . 

Participant observers can overcome people’s suspicions and their own 
discouragement by establishing a solid data-gathering base, communicating 
competence, and maintaining access to data through leader support and the 
enactment of an effective research role. 

It is natural for researchers to be concerned with explaining their pres- 
ence to people and dispelling any suspicion. It is generally true that, it 
participant observers communicate friendliness and good intentions and 
keep confidences, people will probably accept them. Whyte (1943), as other 
participant observers, learned that his acceptance: 


. .. depended on the personal relationships | developed far more than upon any 
explanations that | might give. . . . If | was all right, then my project was all right; 


if | was no good, then no amount of explanation could convince them that the 
book was a good idea. (p. 300) 


Participant observers further develop relationships and build trust with 
the significant individuals within the setting by promising and maintaining 
confidentiality (Bain, 1960; Gullahorn and Strauss, 1960). Preserving confi- 
dences marks the Participant observer as a trusted individual, alleviates 
suspicions, and aids in the eventual development of a working rapport. 
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Maintaining confidentiality helps relieve anxieties about repercussions that 
may result from the information people share with the participant observer. 
As researchers, counselors can maintain confidentiality in the published 
reports by disguising identities, locations, and attributes (Geer, 1964; Lynd 
and Lynd, 1937). 

The participant observer's acceptance and data-gathering may also 
depend on the continued support of the formal leaders who can help ensure 
their subordinates’ cooperation. For example, if a counselor is evaluating a 
guidance program in a girls’ reformatory, the ongoing assistance of the 
institution’s administrator and the counseling program's director are re- 
quired for sustained access to sources of data about the girls, counselors, 
and the program site. Once the participant observer has gained permission 
for entry into a setting, the assistance of the informal leaders of the girls’ and 
counselors’ subsystems becomes imperative. Similarly, the participant 
observer's work in a field study may hinge on having a solid relationship 
with informal leaders (Whyte, 1943). . 

Furthermore, the participant observer's research or evaluation role may 
Provide a license to gather data about various aspects of a program or 
research setting. For example, ifa counselor is evaluating a volunteer BEE 
ing program in a prison, interacting with such diverse individuals as the 
Program’s director, the volunteers, the prison superintendent, and the in- 
Mates and guards will afford a more well-rounded evaluation of the program 
than could be attained from any single perspective. Legitimate access to the 
three major subgroups of the program (i.e. the inmates, guards, and volun- 
teers) enhances the counselor's acceptance and data-gathering efforts. Such 
access to data is particularly valuable in total institutions, such as jails or 
Prisons, which are often not open to researchers or evaluators (Heffernon, 
1972), 


The Participant Observer's Involvement with the People and the 


Setting 


The researcher’s active involvement while observing is an excellent means 
of capturing data about people’s spontaneo’s interactions without disrupt- 
ing the social fabric. “It has the value of offering to perception the actual, 
natural human contact with all the real feelings present and unguarded 

(Dollard, 1937, p. 18). Participant observers can learn a great deal by main- 
taining an active position for recording data, developing working relation- 
ships with people, and immersing themselves in the field or program setting 


(Bruyn, 1966; Liebow, 1967; Wax, 1960). oe 
The participant observer's involvement in a setting during the initial 
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research phases is especially effective for formulating the important ques- 
tions. The researcher in an unfamiliar setting generally does not know what 
questions or data are important (Dollard, 1937). The researcher can also 
gain answers to questions unasked. Such an approach provides data through 
the participant observer’s own experience and also helps attenuate the anxi- 
ety aroused by methods that confront people with questions about them- 
selves and their activities. 

Investigators who initially pursued interviewing in areas of their central 
research interests were often disappointed in the results because they found 
that asking numerous questions tended to exacerbate people’s fears 
(Richardson, 1960). People also became impatient with constant question- 
ing (Bain, 1960). Some researchers stopped asking questions about con- 
troversial issues and gained information through their day to day involve- 
ment in the setting. They felt that this approach was necessary for obtaining 
valuable data (Riesman and Watson, 1964). A counselor who is evaluating a 
milieu therapy program in a physical rehabilitation center may spend time in 
the setting, learn about the program routines and activities, and experience 
the environment, program, and people firsthand. The counselor can thereby 
observe and evaluate the effectiveness of the facility and the program in 
accommodating the physical handicaps of the clients. Through participant 
observation, the counselor can also informally record notes on client com- 
ments and progress regarding their emotional and psychological adjustment 
to their handicaps. , 

Initially, it may be best to ask only the least threatening questions until 
one achieves adequate rapport. Otherwise, one may unwittingly ask embar- 
rassing or indiscreet questions (Dalton, 1964). Whyte (1943), for example, 
learned the inadvisability of inquiring too closely about people’s activities 
before a degree of trust and rapport had been established. One of the leaders 
in the setting cautioned Whyte (1943): 


Go easy on that “who,” “why,” “when,” “where,” stuff, Bill. You ask those 
questions, and people will clam up on you. If people accept you, you can just 
hang around, and you'll learn the answers in the long run without even having 
to ask the questions. (p. 303) 


Likewise, a counselor who is evaluating a jail program would be wise not to 
ask the guards questions about physically subduing inmates or inmates ques- 
tions about contraband in the jail until very solid relationships had been 
developed over a lengthy period of time. 

The participant observer's involvement in a setting can help provide an 
inside view of a particular culture. For example, Polsky (1962) found that 


PARTICIPANT OBSERVATION 161 


spending time with juvenile delinquents helped him understand “. .. the 
frame of reference by which they perceive each other and the world” (p. 
120). Dollard (1937) describes some of the skills required of a participant 
observer during involvement in a setting: 


He can use a good ear for the overtones in a social situation; for the little clues 
and contradictions in the statements and behavior of others; for jokes made at 
his expense; and for the implicit boundaries which guide his relationships to 
others, and which oftentimes are not visible until he has transgressed them. 
People may not tell him directly what he wants to know, perhaps may not know 


how to, and they will certainly not be able to give him a theory of their culture. 


What they will do is illustrate it for him, set it out, and in the best case be their 


true selves before his eyes (Dollard, 1937, pp. 18-19). 


These skills require intensive observation and detailed recording of events. 


The Participant Observer's Method of Recording 


By becoming involved in and recording notes about activities, the partici- 
Pant observer may better understand a setting or program. An effective par- 


ticipant observer learns to balance firsthand involvement in the setting with 
à second-party detachment. The value of the participant observer rests with 
D ability to understand how the people being studied think, feel, and be- 
ave, while he or she maintains a detached observer stance, which allows 
Or accurately recording and incisively interpreting data (Powdermaker, 
ane Without both participating and observing, ee 
either not have access to crucial data or be 199 involved in the setting to 
“curately conceptualize experiences and observations (Gullahorn an 


Strauss, 1960; Vidich, 1955). 
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The typed report was a much enriched version of the notes of the day, which 
were usually a cryptic shorthand of occurrences. (See also Dalton, 1964). 

Taking notes during the day was valuable because the mood of the 
class, my feelings, and the events taking place often changed abruptly, as my 
journal indicates: 


I take notes during the day, which is necessary to capture the vacillating feel- 
ings, thoughts and incidents. It gives a better feel for what happens not just day 
to day but incident to incident; moment to moment. Further, it is not uncommon 
for me to feel helpless one moment while the next moment brings great events 
and I am happy and proud of my students. 


Typing notes soon after they were recorded is an effective way to 
obtain a reasonable representation of what occurs. Dollard (1937) provides 
a rationale for this as he asserts, ‘New impressions should be painstakingly 
and immediately recorded in writing because they soon cool off and the 
sensitive edge of one’s reacting mental surface is dulled by repetition’’ (P- 
20). This data-gathering approach allowed for the freshest recall of feelings 
and events. Otherwise, one does not get a thorough account; many details, 
emotions and events are lost and more and more inaccuracy occurs. 


Feel much better when I can type up the day’s account that very same day—that 
is, come up with what I can honestly feel to be a complete account of the day 5 
happenings including my own thoughts and feelings. There may be, and often 
are, thoughts and remembrances which come up on later days which I make 
note of and try to date as accurately as | can as to when they had occurred. | 
don’t feel badly about this as long as I feel good about having written that 
somewhat “complete” account. 


Such a complete accounting was often difficult to accomplish. Events and 
feelings arose so rapidly that it was just not possible to record everything- 


The Participant Observer's Response to the Limits of the Method 


The limits of participant observation entail the researcher's bias or selectiv- 
ity, taking things for granted due to involvement, inability to understan 

one’s own impact on the situation, conflict between one’s participant an 

observation roles, and great amount of energy and time expended. In re 
sponse, research relationships have been developed to provide systematic 
aid to participant observers and minimize the effects of these potential prob- 
lems. These relationships include: (1) a “knowledgeable other” who is not 
directly involved in the setting but has an ongoing supervisory relationshiP 
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with the participant observer and generally has a great deal of experience in 
settings similar to the research site; (2) highly experienced observers or 
Participants in the research site who can check on the accuracy of the 
Participant observer's recordings; (3) an “adversary” who cross-examines 
“each specific bit of evidence from which the investigator wishes to draw an 
inference” (Levine, 1974, p. 674) and develops rebuttals to data gathered to 
Support a proposition. ter 

Participant observers who write about their own activities should be 
especially alert to problems of bias and selectivity and prevent resultant 
errors through the use of a knowledgeable other. A knowledgeable other can 
help the participant observer gather as unbiased a sample of events as 
Possible. As | recorded in my journal, the knowledgeable other “told me to 
think through what | am not recording.” This admonition helped me to 
gather new areas of data | had previously found threatening. When doing 
Participant observation in the role of a teacher, | naturally wanted my writ- 
ings to reflect positively (though honestly) on my functioning asa teacher. 
Although | was trying to generate as accurate a series of recordings as 
Possible, | was facing many personally threatening crises in the classroom. | 
found that, for about the first month, | scarcely documented events that 
reflected negatively on my teaching performance. | therefore inaccurately 
underrepresented these occurrences in my journal. The following peni 
Pant observation note portrays a capsule view of situations that were ardu- 


ous to endure as a participant (a teacher in this case), let alone record asan 
observer: 


It took five days to have the guts to face myself and maa ln | 
let my students return singly to our room from lunch to ran ne fa 
trouble. I used this method because | have had a hard ti 


quiet, orderly lines. ; i r class 
They still banded together, and made enough noise to pat a le i 
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kids to our room by another route and ducked up that Thad Ben exposed. 
returned to class, I was furious and really let them have It 


i I didn’t get angry at my kids. | 
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understanding of his own biases and preoccupations and to greater under- 
standing of his own pattern of recall and forgetting ...” (p. 253). Such 
assistance affords a fuller sampling of events and interpretations. 

The participant observer’s discussion of the findings with an outsider 
can also help overcome the blind spots that may develop due to researcher 
involvement. 


We can hardly avoid becoming personally involved and thus shut out valuable 
data. We can help ourselves to some extent by simply being aware of the 
tendency of taking things for granted. Then it is useful to have someone outside 
of the situation to whom we regularly describe and explain our observations. 
The outsider does not take anything for granted, and his questions are a 
safeguard against growing blind spots. If we write progress reports at fairly 
frequent intervals, we will find, as we read them over, points at which explana- 
tions are weak or at which they are needed and not provided (Whyte, 1951, P- 
510). 


The knowledgeable other, who is not so involved as the participant ob- 
server, can ask questions to lend a detachment to the analysis and a coun- 
terbalance to the researcher’s immersion in the setting. The knowledgeable 
other can thereby help the participant observer make explicit that which is 
taken for granted after becoming involved. One such instance recorded in 
my journal states: 


I told the knowledgeable other that the hostility displayed by patients in a state 
hospital could be understood in terms of their favorite attendant leaving the 
ward. While obvious, | had not thought of this explanation until my discussion 
with the knowledgeable other. 


Thus, supervision of a participant observer's work helps provide a more 
accurate and insightful account. 

The researchers’ ability to comprehend their own impact on the situa- 
tion being recorded is another area of concern in participant observation 
(Vidich, 1955). For example, learning to conceptualize my own influence 
on an event was a skill that | developed only through discipline and experi- 
ence. 


When first observing counselors who were consulting in a state hospital, | noted 
that they seemed nervous and ill at ease. | later learned that they felt uncomfort- 
able because | was taking notes. They were not used to people following them 
around and recording their activities. We agreed that | would remain on the 
scene but that ! would record notes only after the events had occurred. After 
some practice, | improved my memory, was more sensitive to what was occur- 
ring, and understood more clearly my own impact on a situation. 
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recording process. Such involvement may be so captivating and energy- 
consuming that, on some occasions, the basic duty of recording events does 
not receive adequate attention. This problem arose during my involvement 
as a counselor participant and made it difficult to take notes of some events. 


I was so engrossed in the case conference that | did not fulfull my duties as a 
participant observer by taking copious notes. In addition, | was so exhausted 
afterwards that | did not reconstruct what had occurred. 


A knowledgeable other could encourage this participant observer to return 
to the task of recording the events of this case conference and stress the 
importance of doing so. 

The amount of time required to record entries is another shortcoming 
of this method, particularly when many events occur. Sometimes, however, 


there is insufficient time to record everything (Blau, 1964; Dalton, 1964). 
For example: 


While I have been writing up my notes about the counseling program in the jail 
for over three hours today, I still have not captured all my impressions and 
observations. Every remembered event triggered another recollection. Although 
exciting, this process is both time consuming and occasionally frustrating. 


A knowledgeable other's assistance could support this participant observer's 


efforts in order to help counterbalance the expenditure of time entailed in 
the research. 


COUNSELORS AND 
PARTICIPANT OBSERVATION 


Valuable participant observation data require an effective entry, involve- 
ment, data-gathering, and response to the limits of the method. Such data 
can contribute to: (1) counselors’ understanding and evaluation of problems 
in a group and systems context; and (2) counselors’ understanding of an 

relation to other care-givers. | shall describe how these classes of problems 
can be studied by the diverse methods employed by participant observers 
including observations, informal interviews, and recordings of daily exper” 
ences or participation. | have sometimes changed the context within which 
the participant observation data were gathered in order to depict the ap- 


plicability of participant observation to counselors’ research and evaluation 
activities in a great variety of settings. 
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Counselors’ Understanding and Evaluation of Problems in a Group 
and Systems Context 


A participant observer’s observations of group dynamics may help evaluate 
program effectiveness. School counselors, for instance, often become 
swamped by referrals of teachers’ most disruptive students. Whether these 
youngsters should be worked with in the classroom or in the counselor's 
Office is a central question. A principal may initiate an in-service program to 
help teachers develop skills in disciplining such students and in mobilizing 
group dynamics of these students’ peers to help the teacher maintain ap- 
propriate behavioral control. Evaluating this program may, in part, entail 
having a counselor spend time in teachers’ classrooms, interacting with 
small groups of students containing the disruptive youngsters, and recording 
events involving the effect of teacher and peer impact on disruptive be- 
haviors of the targetted youngsters. The counselor's following observation 
reveals the powerful influence that a teacher and peers exerted upon such a 


youngster: 


Robert was upset and tore up his homework assignment. He hides often and 
runs out of the classroom. When he hid today, the teacher ignored him as did 
the other kids and he just got back to work, Thus, it was helpful that he did not 


get attention for his non-constructive behavior. 


This incident illustrates that changes in the teacher and peer behaviors 
Were sufficient to control certain dysfunctional behaviors of this youngster. 
ing, this student was gain- 


However, when the counselor first began observi i 
limit-testing behaviors. By working 


Ing attention for many inappropriate, : s E IVOREN 
with the teacher on curbing this youngster’s disruptiveness, positive inci- 
dents such as the one quoted became more frequent and the teacher was 
less likely to refer such a youngster to a counselor. This development al- 

s direct service load. If 


: 4 n 
leviated the pressures on this aspect of the counselor rect 
Counselor observations in other classes revealed similar findings, these data 


would provide some evidence for concluding that the in-service program 
enhanced teacher effectiveness in constructively relating to socially disrup- 


tive youngsters. 

A participant observer's inf 
Promote better understanding © 
clients, In one instance, house paren 


‘ormal interviewing of respondents can also 
f the relationship between care-givers and 
ts asked a counselor to study the prob- 


lems they faced at a youth detention center. One basic question was “Who 
is in charge here?” The counselor was able to generate informal interview 
data by talking with people in the setting and learning about the social 
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control techniques used by the house parents and their consequences. In 
this case, the counselor learned that the house parents had difficulties with 
certain youths picking on one another and not following staff directives. The 
following participant observation entry, reported by a house parent to the 
counselor, provides a view of this house parent’s growing mastery over her 
charges’ maladaptive behaviors toward each other after arduous trial and 
error efforts: 


The detainees relate better than expected when they are put on the line. For 
example, Gayle often complained to me that the other girls picked on her. I told 
Gayle that she should behave today and ignore the kids’ taunts. Then I told 
everyone else not to bother Gayle. For the first time, Gayle did not report being 
hassled. 


This incident shows the importance of staff members stating explicitly their 
expectations. As a result, the counselor’s data regarding the presence OF 
absence of this important aspect of social control helped house parents 
understand the effectiveness of such a technique in handling small groups of 
similar youngsters. These data would have been strengthened if interviews 
with the detainees also revealed their need for firm direction from their 
care-givers. 

A counselor can use participant observation in daily professional life to 
help understand problems that arise in, reflect, and are created by the struc- 
ture of a social system. For example, a counselor in a community mental 
health center took notes on observations, interviews, and contacts with the 
local school’s special education teachers, students, and administrators. IN 
this situation, special education classes contain high risk segments of the 
school population because the students have been unsuccessful in adapting 
to regular classes. This participant observation attempted to derive a firmer 
understanding about the special education program and the students’ rela- 
tionship to other students, teachers, and elements of the public school sys- 
tem. The following participant observation account by the counselor reveals 
how a lack of structure for integrating special education students into 4 
regular class negatively affected the students and the teacher. 

| began to receive a number of similar referrals from the same special education 
teacher. The students were said to be anxious and regressing in their academic 
and social functioning. After meeting with these students, I talked with their 
teacher. I learned that these youngsters were the ones who were functioning up 
to grade level in different subjects. Therefore, the special education teacher was 
trying to re-integrate them in the regular classes where those particular subjects 
were being taught. Because of a lack of structure in the school for meeting Wil 
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the regular class teachers, the special education teacher felt “uptight” about 
burdening them with his students and felt uneasy because of a lack of guidance 
as to what the best placements would be. The students were not adequately 
supported in this situation of uncertainty and therefore were feeling upset during 


this time period. 


ministrative structure lessened the stu- 
ptation to a regular class. The lack of 
nd regular class teachers pre- 
best student placements, and 
the difficult transition period. 
t of certain administrative pro- 
hat regular class placement. If 
ate aspects of the special 
led one of the program’s 


The absence of an appropriate ad 
dents’ chance for a successful ada 
communication between special education a 
vented discussion and implementation of the 
the ways students could be supported during 
Participant observation can discover the effec 
cedures on the students’ success or failure in t 
the mission of this counselor had been to evalu 
education program, these data would have revea 


shortcomings. 


Counselors’ Understanding of and Relation to Other Care-givers 


The value of participant observation extends beyond helping counselors 
Understand client problems involving group and system dynamics. The pro- 
Cess of collecting data about these problems also illuminates the functions 
and perspectives of the care-givers in the research setting. The counselor's 
research and evaluation activities require an understanding of these care- 
givers. Doing participant observation may help the counselor better under- 
Stand other care-givers by providing data about: (1) The care-giver's situa- 


tion and job demands; (2) the support that the system gives these care-givers 
to meet those demands; and (3) how the couns 


elor’s own role and skills 
differ from, and complement, those of the care-givers being studied. 
Participant observation enhances a counse 


lor’s understanding of the 
stresses that other care-givers experience in their work. The issue of staff 
burn out” in people-serving agencies is a Cr 


ucial one (Freudenberger, 
1974). One such counselor studied staff stress in a group foster home by 
Working on a number of day, 


night, and weekend shifts. The counselor 
observed and experienced the difficulties encountered by the staff and inter- 
Viewed them about their views 


concerning the emotional demands and 
rewards of their work. The following account provided the counselor with 
an appreciation for the constant pressures that staff members were facing: 


The staff's behavior is constantly scrutinized by the youngsters who frequently 
call them liars when a staff “promise” was not fulfilled. This “promise” may 
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have consisted of a staff member’s nod, wave of a hand, or a mumbled “o.k.” 
while engrossed with someone else. Such close scrutiny and split-second deci- 
sions drain the staff's emotional strength. 


The counselor learned that these pressures often led to conflicts between the 
staff and the youngsters. This account gave the counselor a feel for the 
limitations to be considered if the administrator of the group foster home 
planned any change efforts. That is, the counselor’s awareness of the mul- 
titude of demands placed on the staff helped prevent the mistake of recom- 
mending any cumbersome change efforts that would require a relatively 
distraction-free staff for effective implementation. Further, such data would 
alert the counselor to the potentially unsettling problem of high staff turn- 
over if these stresses were not counterbalanced by the provision of suffi- 
cient supports in the system. 

Participant observation can help counselors evaluate an agency’s abil- 
ity to provide adequate supervision to support the efforts of its front-line staff. 
For example, a counselor who was evaluating the supervision of staff at a 
treatment facility for addicts spent time “hanging out” at the center to learn 
about the functioning of the outreach workers. Her observations confirmed 
the following account reported to her by one of the outreach staff about a 
lack of on-going supervision. 


Although my supervisor keeps telling me that he is there to help me out, | do not 
feel comfortable asking him for advice. He is the guy judging my work so I do 
not want to show him my weaknesses. 


Awareness of this situation can help the counselor understand the outreach 
workers’ difficulties in coping with the demands of their work. Such an 
understanding led the counselor in this situation to recommend that the 
facility's director supply regular supervision for the outreach staff and be 
more careful in assessing a worker's ability to contribute to a planned inter- 
vention without such continuous assistance. 

Participant observation can help the counselor understand the role 
demands, goals, and methods of other professionals that may be similar Or 
different from those of the counselor. The greater the counselor's knowl- 
edge, the more likely he or she will function effectively in both a therapeu- 
tic role with clients and in a consultive role with other care-givers. Further, 
the counselor will be more likely to be accepted by other professionals an 
thereby in a position to understand and resolve various problems. For in- 
stance, counselors and teachers sometimes have differing perspectives © 
students. A counselor at an institution for the mentally retarded used her 
own experience in that setting to generate data. These experiences provid 
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information about the varying roles and functions performed by different 
professions in the same setting. The counselor gathered information through 
a mixture of observations in the classroom, counseling office, staff meetings, 
and interviews with staff about their aims, roles, views of problems and 
interventions, and feelings about cooperative work efforts with other profes- 
sionals. The following data reveal how the counselor had to re-adjust her 
view of a situation to conform more functionally to that of a client’s teacher. 


Bart was upset because he did not finish his math test. When I have previously 
worked with children, | tried to help them understand their feelings. In this 
instance, | would have discussed Bart’s disappointment with his exam. How- 
ever, | realized that a teacher demands more than understanding feelings. A task 
remains to be completed—the math exam. The child must perform well on a 
specific exam. It is not enough to help him understand his feelings. Therefore, 
much more is demanded of a teacher and the students. 


A counselor generally focuses more on client feelings, while a teacher's 


emphasis rests more with client behavior or performance. For counselors to 
work together effectively with teachers and other care-givers for the client's 
benefit, they should understand such differences in perspectives and em- 
phases. Doing participant observation can provide information that will help 
counselors work toward maximizing the utilization and coordination of 
varying care-giver skills and abilities ind minimizing situations of potential 


conflict. 


CONCLUSION 


Participant observation enriches counselor understanding of individuals, 
groups, and social settings. The counselor's proficient entry, involvement, 
and data-gathering increase the production of cogent insights about ac- 
tivities, thoughts, and feelings, despite the problems inherent in this method 
of research. The intimate perspective and access to data available through 
Participant observation enables counselors to discover the important dimen- 
sions of research problems and programs: Such discoveries aid in the de- 


velopment of hypotheses about key social phenomena. Counselor involve- 


Ment in a setting allows for conducting longitudinal studies of essential 


events and changes that occur over time. Therefore, participant observation 
Provides data for understanding and evaluating client problems, care-giver 
responses, and program impact. 

These valuable contributions may well form the foundation for the 
rightful acceptance of qualitative methods such as participant observation. | 
believe that this acceptance will lead to increased usage, greater knowledge, 
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and a further articulation of this method’s vital assets. These developments 


can—and | believe will—enhance counselor effectiveness in their research 
and evaluation activities. 


REFERENCES 


R. K. The researcher's role: A case study. In R. N. Adams and J. J. Priess 
ds.), Human organization research. Homewood, IIl.: Dorsey Press, 1960. 


observation to the study of 


Balaban, R. M. The contribution of participant 
| Journal of Mental Health, 


pro R ‘i ` 
cess in program evaluation. The Internationa 


1973, 2, 59-70. 


B . . 
a H. S., Geer, B., Hughes, E. C., and Strauss, A. Boys in white: Student 
ure in medical school. Chicago: University of Chicago Press, 1961. 


The dynamics of bureau- 


Blau ‚ 
, P. M. The research process in the study of 
New York: Basic Books, 


cra 
a In P. E. Hammond (Ed.), Sociologists at work. 


Br r 
uyn, S. The human perspective in sociology. Englewood Cliffs, N. J: 


rentice-Hall, 1966. 
in Men who manage. In P. E. Ham- 


Dalt 
Mond M. Preconceptions and method | 
(Ed.), Sociologists at work. New York: Basic Books, 1964. 


Dol i 
lard, J. Caste and class in a southern town. Garden City, N. Y.: Double- 


ay, 1937. 

Freud ' 

Wage” H. J. Staff burn-out. Journal of Social Issues, 1974, 30, 
work. 


G . . 
<er, B, First days in the field. In P. E. Hammond (Ed.), Sociologists at 


ew 
York: Basic Books, 1964. 


tions. Social Forces, 1958,36, 


Gold 
pa Roles in sociological field observa 


ker in union research. In R. N. 


Gull 
ahorn, J. and Strauss, G. The field wor 
173 


174 THE COUNSELOR AS RESEARCHER 


Adams and J. J. Priess (Eds.), Human organization research. Homewood, Ill.: 
Dorsey Press, 1960. 


Heffernon, E. Making it in prison. New York: Wiley-Interscience, 1972. 


Junker, B. H. Field work: An introduction to the social sciences. Chicago: 
University of Chicago Press, 1960. 


Levine, M. Scientific method and the adversary model: Some preliminary 
thoughts. American Psychologist, 1974, 29, 661-677. 


Liebow, E. Tally’s corner: A study of Negro streetcorner men. Boston: Little, 
Brown, 1967. 


Lynd, R. S. and Lynd, H. M. Middletown in transition. New York: Harcourt 
Brace Jovanovich, 1937. 


McCall, G. J., and Simmons, J. L. Issues in participant observation: A text and 
reader. Reading, Mass.: Addison-Wesley, 1969. 


Merton, R. K., Reader, G. G., and Kendall, P. L. (Eds.) The student- 
physician: Introductory studies in the sociology of medical education. 
Cambridge, Mass.: Harvard University Press, 1957. 


Polsky, H. W. Cottage six. New York: Russell Sage Foundation, 1962. 
Powdermaker, H. Stranger and friend. New York: Norton, 1966. 
Richardson, S. A. A framework for reporting field-relations experiences. In R. 


N. Adams and J. J. Priess (Eds.), Human organization research. Homewood, 
Ill.: Dorsey Press, 1960. 


Riecken, H. W. The unidentified interviewer. American Journal of Sociol- 
ogy, 1956, 62, 210-212. 


Riesman, D., and Watson, J. The sociability project: A chronicle of frustra- 


tion and achievement. In P. E. Hammond (Ed.), Sociologists at work. New 
York: Basic Books, 1964. 


Rosenhan, D. L. On being sane in insane places. Science, 1973, 179 
250-258. 


PARTICIPANT OBSERVATION 175 


Schwartz, M. S., and Schwartz, C. G. Problems in participant observation. 
American Journal of Sociology, 1955, 60, 343-354. 


Vidich, A. J. Participant observation and the collection and interpretation of 
data. American Journal of Sociology, 1955, 60, 354-360. 


Wax, R. H. Twelve years later: An analysis of field experience. In R. N. 
Adams and J. J. Priess (Eds.), Human organization research. Homewood, Ill.: 


Dorsey Press, 1960. 


Webb, E. J., Campbell, D. T., Schwartz, R. D., and Sechrest, L. Unobtrusive 
measures: Nonreactive research in the social sciences. Chicago: Rand Mc- 


Nally, 1966. 


Whyte, W. F. Street corner society. Chicago: The University of Chicago 


Press, 1943. 


Whyte, W. F. Observational field-work methods. In M. Jahoda, M. Deutsch, 
and S. W. Cook (Eds.), Research methods in social relations, Vol. Il. New 


York: Dryden Press, 1951. 


CHAPTER 6 
Evaluating Programs: 
Models and Strategies 


Harman D. Burck 


Most counseling, guidance, and human services are rendered more on the 


basis of faith and good intentions than they are on the basis of whether they 
are effective in meeting their claims. A broad review of professional journals 
ial work, rehabilitation, 


In the helping professions (clinical, counseling, socia’ \ | 
h articles that are trivial and irrelevant to 


etc.) reveals a myriad of researc ial and tte 
field situations. Also, a lack of interrelatedness and unity is evident. This is 
shocking because few professions Of enterprises in our society have enjoyed 
the financial gravy train for so long, and yet been so immune In accounting 
for themselves. However, with shrinking resources for society's helping ser- 


Vices, and more subpopulations wanting a share of the money (elderly, 
d the mandate from the general 


Mid-life clients, etc.), the party is over, an a 
Public, as expressed through legislators and governmental bureaucrats is 


quite clear: Counselors—account for yourselves! : 
Previous chapters have dealt with many of the reasons for this state of 


affairs: inappropriate use of group means to indicate change; inappropriate 
observation systems; lack of follow-up, lack of commitment to de- 
Psychologize human ‘services, and failure to defend our output in opera- 
tional, measurable terms, and so on. In this chapter we look at several 
additional reasons. The central theme here is a hard plea for the practitioner 
to consider seriously different ways tO demonstrate accountability, notably 

greater use of contemporary and emerging evaluative methods. We don't 
need More research, we need better and more appropriate evaluations 


(Burck and Peterson, 1975). In this chapter, we (1) look briefly at some 
efinitions in order to have a greater common base for understanding some 
Of the terminology, (2) forcefully contrast the concepts of evaluation and 
"esearch so that readers can examine some of the “rigorous scientific” no- 
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tions with which they were heavily dosed in undergraduate and en 
research courses (as they were being doused with statistics), (3) provi ni E 
introduction to some of the more recent and emerging evaluation models, 
and (4) present three examples of evaluation of human services programs. 


TERMINOLOGY 


Certain differences in definition between the terms evaluation and research 
lead to confusion for practicing counselors who are being charged with 
accountability of their efforts. Here are some definitions; in all cases em- 
phasis has been added. 

What is evaluation? It may be defined as 


the systematic process of judging the worth, desirability, effectiveness, or 
quacy of something according to definite criteria and purposes. In a bra \ 
sense, evaluation can be defined as the process of deciding the value of som 


: i ME 7 T, 
thing or as the science of providing information for decision-making (Saube 
1973, p. 89). 


m DE e en 2 izin 
including the task of: establishing desired objectives, collecting and organik ai 
information to assess the accomplishment of objectives, judging the adeque 


of accomplishments, and making decisions for improving programs (Wyson& 
1972, p. 33). 


f i ; hose 
a judgment of merit, sometimes based solely on measurements such as age 
provided by test scores but more frequently involving the synthesis of va 


inds Ol 
measurements, critical incidents, subjective impressions, and other kinds 
evidence (Ebel, 1965, p. 450). 


À judg- 
the process of delineating, obtaining and providing useful information for JUCE 
ing decision alternatives (Stufflebeam, et al., 1971, p. 40). 


Evaluation, then, always consists of at le 
outcomes, and some (3) judgments of worth 

What is research? It is designed to ad 
depict, correlate, conceptualize, and test, 


2) 
ast three parts: (1) process, | 
or value, 


is, to 
vance knowledge, that i$, 


ER: $ 5 : ind- 
These criteria do not include practical considerations-they do not require i or 
ings to be relevant to current operating problems, useful to practitioners, 
translate into new products (Stufflebeam, et al., 1971, p. 72). 


It is 


; 5 
a science concerned with the study of process or the interdependence of ati 
or phenomena... . it usually involves the test of some hypothesis concerning ö 
relationship between an independent or “causal” variable and a depende” 
‘effect’ variable: i.e., the more a, the more b (Suchman, 1967, p. 12). 
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Research is concerned with furthering the individual disciplines and 
deals with problems generated and solved within the disciplines themselves. 
It involves the search for theoretical models that explain and predict 
phenomena of some definable kind and with the means for measuring and 
Codifying the phenomena. 

Research is 


fic knowledge. There is no need for research 
be great concern for making 
and dependent variables is 


aimed at the advancement of scienti 
to be immediately useful or practical, and there can 
sure that the exact relationship between independent 
known (Oetting and Hawkes, 1974, p. 435). 


From these definitions we can conclude that the aim of evaluation is to 
and efficiency, whereas the aim of research is 


establish worth, effectiveness, i ; 
to describe relationships of cause-effect between and among variables. 
There is some overlap, yet there are some variations, at least in degree, that 


allow us to speak of evaluation and research as separate kinds of activities. 
Table 6-1 is an attempt to highlight and illustrate some of these differences. 
No attempt is made to suggest that either evaluation or research is any better 
than the other, or is to be valued any more than the other. The point is that 
traditional research models are often insufficient and inappropriate to ad- 
dress the many demands and constraints found in the delivery ot human 


Services, 

Table 6-1 reveals that research, in € 
e More fee ete and discipline bound, exerts greater control over 
the activity, produces more results that may not be immediately applicable, 
'S more sophisticated in complexity and exactness of design, involves less 
Judgment of the researcher, and is more concerned with explanation and 
Prediction of phenomena. Conversely, evaluation is more mission oriented, 
May be less subject to control, is more concerned with providing informa- 
tion for decision-makers, tends to be less rigorous or sophisticated, and is 
Concerned primarily with explanation of events and their relationship to 
&stablished goals and objectives. One primary difference between A 
activities is that evaluation is done at the site of the intervention (in the field, 
usually), which allows much less control over all variables. ana 

With evaluation emerging as a distinct set of purposes, methodo a 
roles, and outcomes, there appears to be a new discipline being formed, 


Which has been referred to as evaluation research by Wortman (1975) and 
VY Suchman (1967) and as evaluative research by Nelson (1975). Clearly, 
"© amount of control that the investigator has over the situation (all vari- 
ables) js one of the important single dimensions that determines how close 


omparison to evaluation, tends to 


TABLE 6-1 


CHARACTERISTICS OF EVALUATION AND RESEARCH 
DIFFERENCES 


DIMENSION 


Purpose 


Process 


Level of control 


Control subjects 


Setting 


Social context 


Personnel 


Instrumentation 


Measurement/data 
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EVALUATION 


To collect information for 
decision-making 

To explain 

Mission-oriented 

Systems approach models 
(e.g., CIPP, PERT) 


Treatment intervention 
usually cannot be reported 
completely because often 
not fully controllable or 
recordable 

Concerned with relationship 
between outcomes and 
established goals 

Process more 
general—minimal amount 
of control 

Use of nonequivalent control 
Ss often used 

In the work or 
delivery-system situation, 
in vivo 

Embedded in a social 
network 

All personnel (intervenors 
and evaluators) must 
endorse and cooperate for 
maximum impact 

Program usually cannot be 
started over again 

Usually constructed for 
specific program 
(home-made); high content 
validity 

Less precise 

Use of available data 
permitted 


RESEARCH 


To provide knowledge that is 
more generally valid 

To explain and predict 

Theory-oriented 

Traditional experimental 
designs (randomness, 
hypothesis testing, rigorous 
controls, sophisticated 
statistical analyses, 
operational definition, © 

Treatment intervention can 
be reported more 
completely because more 
controllable and 
recordable. a 

Concerned with relationship 
between independent an¢ 
dependent variables 

Order of events quite 
specific—great control 


tc.) 


us A 
Use of equivalent control 5 


Controlled setting, in vitro 


Relatively free from social 
influence 

Cooperation import 
not as crucial bec: 
greater control over 
situation 

Research study can usually be 
restarted 

Standardized measures 


ant but 
ause ©! 


N an 
usually used; reliability “rs 
validity already establish 

More precise 
Decided beforehand illy 


(pre-designed and care 
selected) 
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TABLE 6-1 (continued) 
CHARACTERISTICS OF EVALUATION AND RESEARCH 
DIFFERENCES 


DIMENSION EVALUATION RESEARCH 
Objectivity Judgmental—evaluator’s Less judgmental—researcher’s 
values are explicit and values show more 
ies ; usually respected implicitly, if at all 
st effectiveness/benefit Specific to More generalizable 


program/intervention 
ike dha Great concern i 
utcomes To effect immediate 
change—to assist 
decision-makers 


Immediately applicable; Theory building and 
reconceptualization 


Less concern 
Advance scientific 
knowledge 


O practical 
“eon Is a qualified Is a conclusion, for example, 
recommendation or set of accept/reject the null 


recommendations hypothesis 


© į . . * Fi . 
19 wation is to research and vice versa. This i$ best described by Airasian 
4): 


ed in functioning social settings, its con- 
en the demand for methodolog- 
ing role demands of the social 


Becays 
ae evaluative research Is perlorm 
Cut most often represents a compromise betwe 


Ical ri, , 

80r and the reali litics and exist 
setti reality of the politics TER j 
etting. While the on model of research methodology, with its emphasis 


oe Causality, control groups, and random sampling, is an ogame 
Cont ae, in most program evaluations it is difficult to attain the pre 

rol inherent in laboratory studies. (P- 664) 

place in moving 
which are more 
priate strategies 


ount of activity is taking 
kinds of evaluative models ( 
evising More appro} 


In 
towary ly event, a great am 
Sensitive € construction of new 
an to the real field setting), and d 
niques, 


BVA 
LUATION STRATEGIES 
valuative strategies 


In 
urrently used € 


this 
And Section we di i ië 
iscuss briefly severa i i 
exten odes. The intent is not = provide the reader with an in-depth an 
f tegies (there are too many for our 


Ive 
Coverage of all models and stra 
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space here), but to give some examples of the ones more commonly used, 
and to provide appropriate references. A word of caution: Because there are 
no commonly agreed upon criteria for sorting and classifying evaluative 
approaches into systems, models, strategies, or techniques, and since there is 
overlap among these categories, the reader may well disagree with our 
classification. Feel free to rearrange them according to your own criteria. 
Also, no one model is being presented as the ideal one for all uses and 
occasions, as we shall see later. 


Research Design Model 


This is one of the more traditional and popular models of evaluation, often 
used when a decision-maker wants to establish a causal relationship be- 
tween variables (e.g., attribute change to an intervention). Tuckman (1972) 
feels that the advantages of this model are that it is logical, allows the 
research to establish cause and effect relationships (or inferences about 
them), and provides the conditions for making systematic comparisons. 
Here are the basic steps: 


Step 1. Identification of the aims and objectives of the program (the 
dependent variable). 


Step 2. Restatement of the aims and objectives in behavioral terms 
(an operational definition). 


Step 3. Construction of a content-valid test to measure the behavior- 


ally stated aims and objectives (measurements of the depen- 
dent variable). 


Step 4. Identification and selection of a control, comparison, Of 
criterion group against which to contrast the test group (the 
independent variable). 


Step 5. Data collection and analysis. 
It is obvious that this model is derived from the more traditional scien- 


tific method, although Tuckman has done an excellent job of attempting t° 
modify it for field settings. 


Context-Input-Process-Product Model (CIPP) 


This model is used to establish the relationship among inputs, processes, and 
outputs within a social context, in order to make judgments about worth, 
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effectiveness, and efficiency of a system. Stufflebeam and his colleagues 
(1971, p. 40) define educational evaluation as the “process of delineating, 
obtaining, and providing useful information for judging decision alterna- 
tives.” Hence, basically, the purpose of evaluation is to obtain the right 
Information to pass on to decision-makers. To meet this objective, this group 
has come up with four types of evaluation: context, input, process, and 


Product. 


CONTEXT EVALUATION. This type serves decision-making in the con- 
tinued planning of an ongoing program. It is diagnostic in nature and at- 
tempts to discover discrepancies between program goals and objectives and 
the results of the program. Decisions must constantly be made about pro- 
8ram goals, target groups and their needs, behavioral objectives, and identi- 
fying underlying potential problems. The results of this kind of evaluation are 
changes and modifications in the program that would result in greater con- 
Bruence between intended and actual program outcomes. Some examples 
of this can be seen in the Career Information Service Program later in this 
chapter. The problem was documented and program goals and objectives 
Were stated. Program evaluation and the mechanics for revision and modifi- 
cation were built in. (The reader is also referred to the Discrepancy Evalua- 


tion Model.) 

INPUT EVALUATION. Whereas context evaluation identifies and clarifies 

the program goals, input evaluation provides information to make the goals 

attainable. Input evaluation supplies information about the means necessary 

and available to move toward the program goals. It is an assessment of 
ct and design a project. 


E ONrcEs and provides the answers necessary to sele decides! | 
easibility and availability of resources and strategies are deci here. It 


eals with resources, costs, and benefits, and determines their best use in 
Meeting the program objectives: Examples of this type 4 ee afe 
ERT (Program Evaluation and Review Technique) an te ep i ca 
Nique, In our program example of ccls described later in this € apter the 


Space, facilities, resources, budget, media, ea a = in be zumal 
Sted in determining what the CCIS program wou GOK KÈ. 


PROCESS EVALUATION with a course of action approved (context) and 
‚© Program operating (input), process evalo ope on i Be 
'TOCess evaluation has three main objectives—Me Ne is to de = r a 
'Ct defects in the procedural design during the implementation stage, e 
Second is to provide information for decisions, and the third is to maintain a 
1971, p. 229). Of 


"cord i 1 (Stufflebeam, et al., 
of the procedure as it occurs ( : 
Course, if the put-evaluation decisions have been clear, concise, and con- 
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crete, the process evaluation task will be that much easier. A good process 
evaluation will include assessment of interpersonal relationships and the 
monitoring and managing of communications, resources and logistics, and 
physical facilities. Formative evaluation is one method used in process 
evaluation. Again, in our CCIS program, an example of process evaluation 
might be how well students are performing on the various modules, or how 
well the student volunteers are doing as a result of a workshop. 


PRODUCT EVALUATION. This has been our traditional way of measuring a 
program; that is, at the end or at the product stage. But, in this sense, 
attainments are measured during the program, as well as at the end of the 
intervention. “Whereas context evaluation determines the specifications for 
product evaluation, input evaluation provides the specifications for process 
evaluation. Product evaluation investigates the extent to which objectives 
have been or are being attained; process evaluation the extent to which 
procedures are operant as intended” (Stufflebeam, et al., 1971, p. 223): 
Specifically, product evaluation focuses on the extent to which goals have 
been achieved. Usually, product evaluation is identical to Summative 
Evaluation. Some consequences of a product evaluation could be decisions 
to modify, refund, continue, or terminate a program. In the CCIS program, 
the product evaluation would speak to the matter of students being able to 
do the performance objectives as stated, Be 
These four types of evaluations, which are based on the types ot deci- 
sions that must be made, represent some of the most original and sophisti- 
cated thinking, and one wonders why they are not used more than they are- 


Medical Approach 


More traditional forms of research and evaluation concern themselves with 
previously set goals and objectives, and measure and interpret data CO™ 
lected in terms of those preset standards. The medical approach to evalua- 
tion is concerned with these intended outcomes, but, in addition, 1$ m 
terested in the side effects of the intervention (unintended outcomes) in t ä 
lives of the recipients; in the helping relations, we cannot always be SU" 

that our intervention Strategy will have impact only in the area we intendee 
For example, helping clients wrestle with and resolve some choice points m 
their career development might well have the side effect of higher GPA © 
better parental relationships. The medical approach is quite concern? 

about the client's affective reactions to the treatment process, and seeks K 
explore and explain the ecological context in which the treatment is appli® 

(i.e., the client's social and environmental factors as well as psychologic? 
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ones). Hence, not only the desirability of the outcome is important, but also 
Process and style must be taken into account (Anderson, Ball, and Murphy, 


1975). 


Economic Model 


o variously as time-effort systems, effort 
systems, management cost systems, 
Management by objectives, and others. This model probably has greater 
Control over the quality and quantity of human services than any other one 
discussed in this chapter. As Nelson (1975) so forcefully points out: 


These models have been referred t 
Systems, management information 


<.. accountants record time spent (effort) doing direct services, or in meetings, 
h activity becomes feasible and 


travel, research, etc. A cost per unit time in eacı 
quite easy to calculate. In so doing, accountants have done what psychologists 


and other mental health workers have failed to do: they have developed a short 
term, easily communicable, relatively low cost evaluation system. (p. 707) 
ded to amount of change divided by 


dollars invested equals effectiveness, usually it takes a straightforward dol- 


lars invested/product (in terms of people seen, patients released, etc.) ap- 
Proach to evaluation, and seldom speaks to the issue of quality of treatment 


Or impact on behavioral change. 


Although this model can be exten 


Discrepancy Evaluation Model 
Provus has been the leading advocate of what is termed the discrepancy 
Evaluation model. According to him (Provus, 1971), “evaluation is primarily 
a Comparison of program performance with expected or designed program, 
and secondarily, among many other things, a comparison of client perfor- 
j i utcomes” (p.12). This type of evaluation 
jenis ideal and actual state of affairs, or, put 
ș in a program between what was 
se is made of needs assess- 
le of this model is a situation 
ess a hotline crisis SE eben 
is i sai r mental hea 
had peering that the number of suicides ane Ben: ‘he evaluator might 
' decreased since inauguration © is a discrepancy between 


Sint i - that there 
the int to program decision-makers s sevice ani actual and real 


e Of 
™Pact Nt, specific goals, and objectives 
On the community. 


An examp 


er j 
„Sre an evaluator is called in to a55 
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Adversary Model 


One of the most unusual and promising, but now impractical, evaluation 
models to be presented here is the adversary model proposed by Levine 
(1974) and Kourilsky (1973). They have questioned many of the assumptions 
regarding the scientific enterprise, and then drawn an analogy between the 
goals and objectives of scientific methods and the adversary model followed 
by the legal profession. Levine states 


... the scientific enterprise as a whole follows an adversary model, both within 
the narrower confines of a single experiment and within the social organization 
of science. By an adversary model, | mean that we are dealing with a situation in 
which there are claims, and counterclaims, and arguments and counterargu- 
ments, each side advanced by an advocate who attempts to make the best 
possible case for his position. (p. 661) 


Levine then goes from the analogy to show how various judicial tech- 
niques can be applied to evaluation and research (e.g., rules of evidence, 
direct and circumstantial, rules of law, etc.). In a very tentative fashion, 
Levine states: “I do not know how such a system would work, and I am 
certain that with experience we would find it necessary to develop a variety 
of ‘designs’ for collecting appropriate data” (p. 672). Finally, he rests his 
case, thus: “There is nothing in what | have said to exclude data gathering 


am itute 
... Of a type familiar to us now. Nor am | advocating that we substitute 
wholly and completely this type of approach for experimentation. i 


arguing that we need a classification for types of problems that are 0 
handled by different modes of approach and that the experiment needs o 
yield the place of honor, or at least to share it, with other forms of researc" 
(p. 674). 

This is an untried model. Only one study has been reported to aae 
—that performed by Stake and Gjerde (1971) in which they summari 
arguments most favorable to a program for talented youth, and then arg 


ments that are most critical of the program. The reader is the decision-mê 
and judge. 


Formative/Summative Evaluation 

a ith 
The basic difference between these two types of evaluation has to do 7 2 
the point of emphasis—process or outcomes. Formative evaluation ÍS ‘al 
cerned with program effectiveness, with the process of testing mate" ro- 
describing subgroups, defining the goals, retesting and modifying pap 
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gram. In fact, formative evaluation begins with the task of problem concep- 
tualization and is subsequently concerned with the development and mod- 
ification of the program as it unfolds. 

The summative evaluator begins after the treatment has been properly 
developed and implemented and is involved with the task of determining 
how effective the program is in attaining earlier set objectives. The summa- 
tive evaluator provides data and feedback for the program developers for 
further revision, modifications, Of applications. 

Essentially, formative evaluation aims to systematically and consis- 
tently improve the program, whereas summative evaluation focuses on 
determining the overall effectiveness of a program. For a more detailed 
explanation of these types of evaluation, see Bloom, et al. (1971) and Scri- 


ven (1972). 


Transactional Evaluation 


This strategy is concerned with the assessment of the adequacy of com- 
Munication among program participants. Much field evaluation takes place 
in professional settings that are inhospitable and even hostile to evaluative 
efforts. This resistance is Se! some well-designed evaluations 
have been sabotaged by noncooperation and actual program manipulation. 
Transactional evaluation takes the crucial variable of people into considera- 
tion and through a series of questionnaires and an 
and other group dynamic techniques, endeavors nm uct innovation an 

new programs into a social system. (See Rippy, 1973. 


Categories of Criteria 


Suchman (1967) proposes five categories of criteria according to which the 

success or failure of a program MAY be evaluated: effort, performance, ade- 

quacy of performance efficiency, and process. These categories are interre- 
lated; let’s look at each of them briefly: 

: pceing of input or energy, regardless of what 

© Fffort represents the assessing Of I ) : 

pres! this is similar to input in other models because it 

the output 15: 115 ation” hat was done? Effort provides 

att swer the QUE" f ce and 

a answers in itself, but 15 related to performan 


particularly efficiency- = just the effort itself 
P the results of effort, not just the Lis , 
erformance measures t of effort ina particular program but no 


There may have been a !0 
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payoff in performance. After performance has been measured, this 
must be compared with the original objective to estimate value. 


e Adequacy of Performance. “This criterion of success refers to a 
degree to which effective performance is adequate to the tota 
amount of need” (Suchman, 1967, p. 267). This measure informs 
the evaluator how effective a certain program has been in terms of 
total population need. It is a very relative measure and depends on 
the level at which the program sets its goals. 


e Efficiency represents the ratio between effort and performance. For 
example, if we find that a program has worked well (that is, comes 
close to meeting goals and objectives), we might want to know if 
there is an alternative way to get the same results. In other woran 
the same results may be obtained with less money, less traine 
personnel, or other choices. 


Process. In many studies the four previous components are enough 
to satisfy many evaluators—that is, to determine whether or not 
program was successful, and to what degree. But process involves 
checking on the why (the reasons) a program was or was not eA 
cessful, or, as Suchman states, “Making sense of the ee 
findings is the basic reason for adding a concern with process tot 
evaluation study. Otherwise one is left with the descriptive results © 
the evaluation, but without any explanations” (p. 46). 


Conclusions About Evaluation Strategies 


We have now looked at several of the more popular and commonly in 
evaluative strategies and models. In summarizing this section, we uses 
that they are derived from a diversity of theoretical and philosophical une 
and vary among many dimensions: from simple to complex, from ae 
useful to specifically useful, tried to untried. For the person who 15 ae 
beginning to get interested in evaluative methods, this array must aopen a 
be a hodgepodge of meaningless meandering on the part of evaluat we 
perhaps this is true. And maybe this state is a healthy one and a stage af 
must go through. More importantly though, as one looks at the vast array öf 
services being rendered, logically it seems that no one evaluative ion 
method is the one. Selection of a model must depend on the populat! 
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oli the purpose of the program, and more particularly what it is the 
foe sponsors and decision-makers want to find out. One important 
desine, seem to pervade the literature in this relatively new multi- 
one i ni and this is that the traditional scientific models used so 
tee psychology and education and which were borrowed in their en- 
u rom the physical and natural sciences, simply are not relevant and 

exible enough to monitor and evaluate the host of human and educational 


Services being rendered in the field. 


EXAMPLES OF 
ROGRAM EVALUATION 


ms, examined some of the differences 


eee evaluation and research, and glanced briefly at some models, what 
ieee this mean to practitioners who are, so to speak, out there holding the 
a that is, the people on the firing line who are providing the best services 
has. think their clientele needs and for which they have been hired? In their 
Del, N most practitioners are not too interested in the theory behind the 
and i system or PATH analysis. Practitioners need instructions, assistance, 

some guidelines to help them find out if what they are doing really 
makes a difference in the lives of the clientele, and some suggestions on how 
to communicate this to program sponsors and financial supporters. This is 


What we attempt to do in this section. Three examples of program evaluation 
Are presented. The first is an actual career information system that has been 
Implemented at a large state university; the other two situations are 
that are operational in many settings. 


Ypothetical, but similar to programs 
We will build our own model eclectically for purposes of this section. 


bviously, you will see that, just as in more traditional research, our 
Values manifest themselves in the very nature of this model and in what and 
a we evaluate. Let's pause now, to make our model explicit. We are not 

88esting that this model or any of the foregoing ones 15 the only proper 
Way to be accountable. It is one way and you are encouraged to criticize, 


nd build your own for your situation. l , 
e basic steps in program evaluation 


We are su no the following fiv 
ggesting the 10 8 $ 
and will use an ‘as the format for the evaluation of the three programs. 


Now that we have defined some ter 


| documentation of the problem 
g of clear and reasonable objec- 
table. Documentation may be 
interviews, or other reliable 
al and empirical data. 


_ A carefu 
es the settin 
be held accoun 
pecial surveys, 1n, 
luding experienti 


a BLEM DOCUMENTATION 
ee assessment) enabl 
erived which a program may 

n from existing records, 5 

comprehensive sources, INC 
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STATING GOALS AND PERFORMANCE OBJECTIVES. The principal ob- 
jective of an evaluation of a service program is to determine whether pro- 
gram activities are effective in reaching program goals. Goal statements de- 
scribe program outcomes in general behavioral terms that are not directly 
measurable. Therefore, in order to serve as meaningful guides, goal state- 
ments are reduced to measurable performance objectives. Performance ob- 
jectives are statements that include three elements: (1) a specific behavior, 
(2) an assessment situation, and (3) a minimum standard of performance. 
(See Mager, 1962, for a detailed explanation.) 

Two categories of goal statements can be used to describe the intended 
outcomes of a service program: Terminal Program Outcomes and Ultimate 
Outcomes. Terminal Program Outcomes concern skills mastered, knowl- 
edge gained, or attitudes acquired at the time a client leaves the program. 
On the other hand, Ultimate Outcomes state the impact the program intends 
to have on clients’ attitudes and behavior for a period of time after they leave 
the program. This latter Category concerns the degree to which the intended 
efforts of the program were internalized into the life styles of clients. 

Once goals with performance objectives have been articulated for both 
Terminal Program Outcomes and Ultimate Outcomes, the nature of the 
Program itself becomes Meaningful and concise. This is a crucial step IN 
program planning and evaluation—it describes what the program is about, 
where it is going, and how one knows whether the what has been attained. 


PROGRAM DESIGN. Once a program leader has articulated goals and 
performance objectives, activities to accomplish these are then planned. 
Unfortunately, too many service agencies employ a cart-before-the-hors® 
planning strategy in program development by outlining activities before 
desired outcomes have been stated. Clear program objectives provide an 
efficient guide for selecting activities either from already successful pro- 
grams with similar objectives or from the creation of new techniques derive 
from theory or from clinical hunches. 


PROGRAM REVIEW FOR REVISION AND IMPROVEMENT. We have de 
cided to use formative and transactional evaluation (Bloom, Hastings, a 

Madaus, 1971; and Rippy, 1973) as a review and revision cycle of Out 
program development. You will remember that the former concems the 
evaluation of specific activities within a program as they contribute to the 


assessment of the adequacy of communication among program participants: 
Examples of formative evaluation studies include the following: the asses% 
ment of the impact of a trip toa factory on client attitudes about an occup 
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tional field: 
of a determination of whether teachers learned basic principles 
als retain u from a workshop; an assessment of whether individu- 
lm ur the ee about the hazards of drug abuse after watching a series 
“posttest desi pe Most often, a short home-made test used in a pretest- 
ness of a u (Tuckman, 1972) is adequate to substantiate the effective- 

ar r activity in facilitating the attainment of objectives. 
ee ional evaluation concerns assessment of the adequacy of 
ecome beet among the participants in a program. Often when programs 
catan sehen ective, the reason can be traced to a breakdown in communi- 
tions includ g the involved individuals. Examples of transactional combina- 
orth in the ® counselor-client (did the client carry out a plan of action set 
and the ad counseling session?), counselor-administrator (did the counselor 
able en agree on program performance objectives and accept- 
counselor ities?), and counselor-teacher (did teachers support the 
Partici "S program by allowing students to be released from class for 
Pation?), 
N 

a AND REPORTING PROGRAM OUTCOMES. It is difficult for any- 
Or Sao about the effectiveness of a service program without a system 
Menting and reporting the program and its outcomes to other pro- 
new and useful endeavors 


Essig 

n : 

at a als. Too often, service programs carry on n 

re neither evaluated nor reported Hence, practitioners do not have 
ues and administrators receive little 


Cce 
feedba i new programs and techniq E 
Should information on which to base decisions. All ne 
airly et evaluation activities and disseminate their Den. os 
€sour ective disseminating process IS through national ERIC ( ucationa 
' ne Information Center) networks. , papae 
dicate h is our eclectic model of evaluation. Let's now 80 $ p: pet 
"Oogram low we might go about evaluating three service progr ; -Theth 
is an operational one, while the other two are hypothetical but 


Pical 
of numerous operating programs: 


Pr 

Ogr, i 
gram One—A Career Information Service 
In 1 l 
“li na Robert Reardon, a counseling psychologist atthe en ae 
ua Center, Florida State University, became concerned about the ina 


e asc r eme mae, 
Center stance most undecided and confused students received in tha 


= . . . . 
Prestig and from the university generally: Vocational counseling is low !n 
€ among counselors; as a result students presenting these problems in 


ou 
Senior ae Centers are usually shunted to practicum Or intern students bY 
staff (for a detailed account of this professional problem see Reardon 
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and Burck, 1975). Reardon decided to do something about re 
and the result was the establishment of a unit called the Curricu = 
Information Service (CCIS), a voluntary, multimedia based, self- he A 
reach program. The following actual evaluations were made of this 2 on 
(Although CCIS has been evaluated using the CIPP model, and two ab 
modules have been used in dissertation research, we will use our ec 
model.) 


SM & 5 i q eee eling 
programs, admissions, orientation, registration, advising, and the oe 
center. Local surveys of faculty, administrators, and students were 


: nd 
on was compared with nafianal polk Ti 
reports on adolescent career-planning problems. These data indicate! 


sp were 
STATING GOALS AND PERFORMANCE OBJECTIVES. Specific goals 


list 
developed to meet some of the student needs. Although several were 
for each, the following are examples: 


Students will be able to: 


a. Describe mistakes 


and problems in career planning among 
college students 


b. Use a theoretical model for career decision-making in 
developing their Own career plans 


c. Identify their primary areas of academic and career interest €: 
in their college years 


d. Locate and use inf, 


; ; F ant 
ormation relevant to their most import 
academic/career a 


Iternatives 


: LEN : : r 
e. Identify university and community resources available fo 
ssistance in the development of academic/career plans. 


; the 
Goals and objectives were also developed for the university (e.8 f 
universi 


: ; rts 
ty will develop resources and materials to support the effo 
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Reula advisors, counselors, and others). For each of the modules, per- 
ormance objectives and criterion rates were established. 


Meere Having established the need and stated some goals 
, a program was designed. CCIS utilized an extensive library 
of books, pamphlets, and other materials. The most innovative aspect was 
the development of five modules that were on videotape and involved the 
Viewer in an interactive way. These five modules parallel the five objectives 
set forth above. Creative art work with brief subtitles made this approach 
appealing. Also, CCIS utilized 110 audio and 10 video cassette tapes, focus- 
Ing on descriptive information about college majors and postbaccalaureate 
Vocational alternatives. The procedures and materials used in CCIS were 
Constantly reviewed and modified as feedback about the program was 
analyzed. In addition, peer-advisors were oriented and trained as para- 
Professionals for CCIS and were available to clients. 
FROGRAM REVIEW FOR REVISION AND IMPROVEMENT. Process evalua- 
= included student reactions to the mo 
al uation form on every visit). These evalua 
Weekly staff meetings where all personnel 


OBS that th tions 
ey kept about program operations, ati 
and so on. If es le had been added, each client/participant was 


asked to complete a brief evaluation form. In addition, over 15 local and 
„Ulside experts observed the program operations and provided their evalua 
na at staff meetings. Also, follow-up questionnaires were mailed to all 
Dan who had een the service. On the basis of this rra SET 
tion es and modifications were made in the service. In this en ie 
, training, and performance of resident hall assistants as p 


Professi isi t, resent- 

ession ; because of disinterest, r 

ents, | ne ie generally unšatisfacton al of one module and 
‚ lack of skill. One revision was 


; the total remov N ig 
me changes in two others. Another changè was that en 
ass, Were no longer used as peer helpers but were replaced by 8 

ants and graduate students in counseling 


satisfactions, dissatisfactions, 


s 
practica. 


TCOMES. Numerous local re- 


NOTI 
NG AND ou Ra 
RE PROGRAM : ; 
ports of evaluati ole de to students, faculty, and en 
hi bahia sider aI mpleted (see Fisher, Reardon, an 
F been made to the 


Bure, ctoral dissertations have been co 

ck, 197 > | reports have 

sI ‘ 6) based CIS studies. Annua pP x ae 

nen SS, the Vice See Student Affairs, and other 

Brar Attempts have been made to gain national visibility and to rep 
Outcomes (Reardon and Minor, 1975). 
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Program Two—Affective Education 


PROBLEM DOCUMENTATION. After a lengthy faculty meeting recently, 
many teachers were expressing a desire to learn more about affective educa- 
tional programs. The principal said he would look into the matter. He called 
in a consultant in this area, who, in turn, called on an outside evaluator who 
was to work closely with the county-wide Director of Research and Evalua- 
tion. The two evaluators immediately prepared and mailed a questionnaire 
to all teachers in the county concerning their knowledge and interests in the 
area of affective education. The results of the survey indicated that 65 per- 
cent of the teachers in the elementary schools wished to learn more about 
affective education and 40 percent indicated a willingness to experiment 
with this type of approach in their classrooms. 


STATING GOALS AND PERFORMANCE OBJECTIVES. The terminal goals 
were stated by the evaluators: after a two-week workshop, participants 
(N=20) will obtain high levels on ratings of understanding, listening, ability 
to reflect feelings, and communication skills in one-to-one dialogues. This 
was understood not to be the total Meaning of affective education, but these 
skills were certainly agreed upon as basic. 

The terminal performance objective was listed this way: Given 4 
role-playing situation, a participant will display high levels (3.5 or better 
on Carkhuff Scales) of understanding, listening, and communications accu- 
racy, to be assessed by peer-participants. 

The ultimate goal was that the teachers would be able to provide grouP 
experiences with free expression of feelings, and the ultimate performance 
objective was that 50 percent of the teacher-participants would use group 
experiences at least three times per week in the 


; fter 
ir classes, three months afte! 
the workshop. 


PROGRAM DESIGN. A two-week workshop was set. About 15 percent of 
the eighty hours was devoted to didactic and traditional instructional a€- 
tivities; about 20 percent of the time was given K 
demonstration/role-playing types of activities supervised by trained observ 
ers and believers in affective education; and the remaining 65 percent ie 
the time was spent in small groups on self-exploration and personal growth 
exercises. The emphasis was on dealing with the affect in interpersona 
relationships. In addition, as follow-up and to ensure greater transfer 2 
training, each teacher was observed in the classroom for two (unannounc® 
hours per week and given feedback about performance. 
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PROGRAM REVISION AND IMPROVEMENT. Formative evaluation was 
done by the county Director of Research and Evaluation. Atthe end of each 
day during the workshop, he or she conducted small group interviews with 
participants and consultants to gain information about progress, feeling, and 
other reactions. Also, the director had each participant complete a ques- 
tionnaire designed for this study, probing learnings and perceived progress. 
This information was given to the consultants in order that they might make 
changes and modify the workshop as appropriate. All written information 
was kept anonymous by the evaluator. Summative evaluations were secured 
by an outside evaluator and included consultant ratings of individual 


teacher progress, as well as peer and self-evaluations of levels of per- 


formance. Finally, each week, each participant was observed in the class- 


room and rated as to levels of affective functioning displayed in interaction 
with students. 
Transactional ev. 
Communication, and co 
and between participants. All ratings were done by tr 


vers. 
The final step assessed performance objectives; also, an accounting of 


all monies expended (both for consultants/observers, and teacher time) was 
completed. Side effects were noted by questionnaires sent to consultants, 
Participants, noninvolved teachers, peers and students in classes taught by 
Participants, and administrators. An attempt was made to ascertain those 
aspects of the workshop that were most beneficial and those that were not, 
as well as causal relationship between participation in the program and 


subsequent behavior. 


aluation involved an assessment of adequacy of group 


mmunication between consultant and participants 
ained outside obser- 


Program Three: A Drug Abuse Residential Center 


attempt to evaluate the center in its entirety, but 


Just one aspect of it, which was a spin-off of a larger annual evaluation. A 


follow-up survey revealed that 60 percent of the males who were treated for 
unemployed six months after 


heroin addiction at this drug abuse clinic were 
treatment, This fact was reported by many of the addicts as the reason they 
went back to heroin usage, since employers who learned of their previous 
addiction either fired them or would not hire them initially. It was a real 
Problem. 

__ Alarmed by this figure, the Director and the Board of Directors decided 
to implementa vocational education program in cooperation with the Voca- 
tional/Technical Center. During the day the clients attended the 


In this program we do not 
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Vocational/Technical Center, where special counselors and guidance per- 
sonnel instituted a program tailored to their needs and interests as well as 
occupational/vocational training (auto repair, upholstering, barbering, etc.). 
An evaluator from the local mental health clinic that sponsors this center 
was secured to evaluate the educational/vocational program. As a terminal 
program outcome he stated the goal: Clients will select a career alternative 
consistent with interests and abilities as judged by counselors. As a terminal 
performance objective, the evaluator stated that each client selected for this 
special program would be admitted to a training program for an occupation, 
or would have secured a full-time job. Ultimately, the goal was that most 
clients would uphold the responsibilities of full-time employment. The 
evaluator stated the ultimate performance objective this way: Six months 
after drug treatment and an appropriate educational training period (depend- 
ing on choice) 75 percent of the clients would either have been in training 
leading to a full time occupation or would have held a full-time job (for a 
period of six months) after termination of their programs. 

So, following our model, we see that this problem was documented as 
a side effect of a larger evaluation. The goals and performances were tersely 
stated, and the educational/vocational program (in addition to the drug 
treatment program) was designed specifically to take care of the stated prob- 
lem of unemployment. Weekly meetings were held with all clients to secure 
feedback on how the program was functioning and several changes were 
made. Transactional evaluation took place by having twice-weekly meet- 
ings of personnel at the drug center, along with counselors and teachers at 
the vocational/technical center, This kept the air cleared and professional 
personnel as well as clients had an open forum for discussing what was 
happening to them and their reactions to it. The results were so good (90 
percent met the ultimate performance objective) that the program was writ- 
ten up in brief form and sent to the state coordinating office for drug abuse, 
which sent it to all other centers in the region. 

In retrospect, and as we look over these three program evaluations, We 
suggest that traditional research methods (control groups, randomness, 
group mean change, etc.) would have been inappropriate in these applied 
situations. Although we realize that better evaluative designs might have 
been offered, a fallback on traditional research methods would not have 
yielded the information necessary to evaluate these programs. 


CONCLUSION 


Appropriate and productive evaluation procedures can provide program 
administrators with information to improve services. Many practitioners 
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view accountability and evaluation from only a punitive standpoint—that is, 
to determine the imperfections of a program. A more primary purpose of 
evaluation is to assist in the determination of activities that are effective in 
reaching program goals and objectives. The information should then be 
disseminated to the profession at large. Lowering client-counselor ratios, 
training more counselors, and increasing professional memberships are still 
important professional matters (Goldman, 1974); yet now is the time for 
counselors to concern themselves with documenting the quality of services 
they provide. An appropriate evaluation strategy is one way of getting on 
with this! 
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CHAPTER 7 
Longitudinal Research: 
Studies in a 
Developmental Framework 


Marshall P. Sanborn 


ere counseling and guidance activities 


In any agency or institution wh 
of individuals or groups, longitudinal 


are aimed at long-range development 
Study and description of how counselees develop is essential. Schools and 


Colleges, for example, are developmental institutions. School and college 
Counselors need to learn the extent to which students at various age or grade 
levels show development in personal, social, vocational, and educational 
areas of concern to the institution. They must be aware of what impact 
specific guidance and counseling activities have on students. 
enh by Garrett and Levine (1962, PP- 430-432) indicates that 
a ttation counseling, like school counseling, must respond to particular 
Ele $ of individuals as these may be paramount at different stages of de- 
adi pnient. Rehabilitation agencies are “‘to achieve maximal function and 

adjustment of the individual to prepare him (her) physically, mentally, so- 
cially and vocationally for the fullest possible life compatible with his (her) 
abilities and disabilities’ (Jaques, 1970, P- 68). Such agencies must learn 
sr extent to which these goals are attained, and the relationship of goal 
attainment to specific rehabilitation procedures. 

Timing of counseling and guidance activities is therefore important and 
Must be predicated on things we are able to learn about developmental 
Stages counselees typically experience. In the broad sense, even 
Psychotherapy is more of a developmental activity than a remedial one. The 
modern theory of Dabrowski (1972) provides a rich illustration of this, 
though Certainly not the only i ds phenomena such as 


i one. Dabrowski regar 
Built as dynamisms—internal forces that propel development. He describes 
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dynamisms as having different meanings and functions at different de- 
velopmental stages. It may be possible, then, to hypothesize developmental 
level on the basis of dynamism function, or vice versa. Thus, a practical 
need for longitudinal study of client development exists in a wide variety of 
counseling settings. Such study can provide us not only with evidence re- 
garding long-range outcomes of counseling work, but also with implications 
for how to deal with clients at the time we are working with them. 

In this chapter we shall focus on longitudinal study as a practical tool of 
the practicing counselor. Longitudinal research may often be applied to 
more “basic” theoretical problems (e.g., Super, 1953; White, 1961; Roth- 
ney, Dearborn, and Shuttleworth, 1938), yet our interest here will be on the 
ways longitudinal research can be put to use within the counseling agency 
to derive practical implications for agency procedures. We shall try to show 
how longitudinal study can be built in to routine counseling and guidance 
activities so as to yield data that will assist us in making immediate decisions 
about our practice and at the same time furnish the basis for long-range 
follow-up of counselees. 

We shall regard evaluation as the primary goal of longitudinal research 
in the practical setting; but we shall try to show also how longitudinal data 
may increase our current understanding of individuals and groups with 
whom we work, and of environmental forces that affect their lives. It 15 
almost impossible to carry on systematic longitudinal research without dis- 
covering that the process generates unexpected knowledge. Data obtaine“ 
during the course of practical daily applications of guidance procedures, | 


scrutinized, inevitably lead to new questions, or to the reopening of ol 
ones. 


LONGITUDINAL RESEARCH 
IN THE PRACTICAL SETTING 


The very term “longitudinal research” sometimes frightens people. On laok, 
ing at the results of a longitudinal study of any magnitude, one can easily a 
the impression that those who were responsible for its conduct must hav” 
had very unusual qualities of ingenuity, patience, and perseverance. Begi 
ning a longitudinal study is somewhat analogous to planting an acorn. on 
never knows if one will live long enough to see the ultimate product. yer - 
we are interested in how long it takes or what conditions are favorable fo 
the acorn to germinate, how to protect the seedling from rabbits, how mar 

inches the sapling grows each year, how nearby foliage affects direction i 
growth, or when the young tree first provides enough shade to sit in on 4 
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summer day, we may find sufficient reason to plant the seed and tend it even 
though we know in advance that the mature tree will shade a later genera- 
tion. 

So it is with longitudinal research in the practical setting. Although 
counseling and guidance goals are stated in terms that usually imply long- 
range consequences for counselees, the processes used and the directions 
taken to work toward those goals are matters of immediate interest. And 
when the long-range product is examined, it will be in terms of the history of 
Processes, experiences, and events leading up to the culminating point. 
Data that yielded information of immediate concern in prior years will 
Provide the history. 

Thus, it is useful to think of longitudinal study as a way of systematizing 
our methods for dealing with immediate questions. We do not have to wait 
for many years to begin experiencing the fruits of our labor. At any given 
Point in the process, we are interested in what is happening now. We can 
trace the development of individuals and groups while we are working with 
them; and thus we equip ourselves to better understand current progress and 
needs. We can assess progress of individuals or groups resulting from any 
given counseling or guidance procedure; and thus derive implications for 
procedure change and improvement. Finally, we can discover how chang- 
ing social and economic conditions may alter the needs of counselees, and 
thereb te in our focus. i 

i bra arei T for longitudinal study does not necessarily Te- 
quire expensive and time-consuming procedures over and above oa 
functions of agency staff. Some specialized efforts such as follow-up studies 
Or studies to determine developmental history of counselees before they 
came to the attention of the agency may eventually be indicated; but the first 
task, and the prevailing one, is to systematize and document current proce- 
dures as much as possible with longitudinal development of individuals in 
mind. 


PRELIMINARY CONSIDERATIONS 

As a first step in development of a systematic longitudinal mee model, 
Several basic questions about the agency and its clientele i e sil 
dered, These questions pertain to agency goals and proce sang 
developmental characteristics of counselees served by the agency. Or bs 
ily, the primary focus of longitudinal study is on development of counselees 
in areas of interest to the agency, and on the relationship of agenty u. 
dures to counselee development. Processes of data collection and analysis 
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depend on an orderly framework of conce 


pts regarding the agency, its pur- 
poses, and its clientele. 


What are the counseling and/or guidance objectives of the agency? 


The long-range goals of counseling and guidance are usually stated in 


idealistic and abstract terms. Blocher (1974, p. 7) for example, states that the 
purpose of developmental counseling is to “maximize human freedom” and 
that a corollary goal is to “maximize human effectiveness.” Miller (1961, p- 


10) cites “‘self-realization”’ as the goal of guidance. Jourard (1964, p. 60) 
says that “authenticity” of the individual is the desired outcome, and Thore- 
sen and Mahoney (1974) talk about self. 


idee j -control as the ultimate goal of 
bel avioral counseling. Carl Rogers (1962) has used the term “fully function- 
Ing person” to represent the | al of th hese 

O'T erapy. Such terms as these, 
or terms at similar levels o a 
Statements. 


sary to derive an operational 
skills, competencies: 
developed. When these have been 
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In the practical setting, longitudinal study of counselees’ development 
begins at this point. It is the set of objectives that provides focus for study. 


Where are counselees in their development at the time we work 
with them? 


This question can be a general one relating to classes or categories of coun- 
selees, or it can be an individualized one relating to a particular counselee. 
Itis probably useful in most agencies to ask the questions with both general 
and individual interest. In the school guidance program we need general 
data, for example, on children’s “typical” levels of development, at various 
Points in their schooling, in areas of concern to school counselors. But when 
working with any particular child, we must remain aware that his or her 
development almost certainly will be atypical in some way. Rothney, Dear- 
born, and Shuttleworth (1938) in the Harvard Growth Studies demonstrated 
this fact, Those studies were completed with 1400 children; yet after the 
final profile was drawn, not one individual person fit the profile. The norms 


id not pertain to a single case. ; , 
f the general question that we may incorpo- 


Nevertheless it is in study © 

rate a theoretical system whereby we order thoughts about human de- 
velopment. In attempting to determine counselee needs and counseling 
Objectives within a developmental framework we need a model to describe 
developmental events counselees may generally be expected to 
experience—either as the “natural order of things” or as a function of our 
efforts to assist their development. We may ee eM needs, design ac- 
tivities, and ress in terms of the mode’. 

_ The oe nn be a simple paradigm whereby we order our 
thinking about an agency—a specific set of developmental phenomena—or 
't may be a highly complex theory intended to order thinking about the 


Whole “race in human development from birth to death. A 
ange: af possibilities m D describes expected stages of 


rehabilitati i for example. 
ation hospital brochure, tor 2 
evelopment in In rehabilitation process of persons who have suffered 


Spinal cord injury: 
1. shock, disbelief, denial 
2. anger, guilt 


bargaining 
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4. depression 


5. acceptance 


“The Realities of th 
Sacred Heart Rehabilitat 
Milwaukee 


Spinal Cord Injury” 
ion Hospital, 


It was observed by Davis (1976, Pp. 11) that these stages resemble those 
outlined by Kubler-Ross (1969) as typical of the process of adjustment to 
death or significant loss. 


Fay patie mgo- ideal.” Appropriatedeveloprony skills include: 
reading, writing, and calculating; learning physical skills 
necessary for Ordinary games; |e 


and Values; and achievin 


2. . 
so Hk of industry (Between 10 and 15 years of age). The 
oe Te on © Organize time and energies to accomplish 
* ey ; g 
achievemat, elopmental task of industry is an important 
3 
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choice, and choosing a vocation are central elements of 

development. Developmental tasks include: achieving more 

mature relations with age mates of both sexes; masculine or 
feminine social role: emotional independence; assurance of 
economic independence; selecting and preparing for an 
occupation; acquiring a set of values and an ethical system; 
preparing for marriage and selecting a mate; starting a family; 
and getting started in an occupation. 


4. Productive person (From 25 to 40). The individual strives to 
master the skills of the occupation and to move up the 
occupational ladder. Havighurst has not clearly defined 
developmental tasks associated with this or following stages. 


5; Maintaining a productive society (Between 40 and 70). The 
individual sees self as a responsible citizen, accepts civic 
responsibilities related to the job, and is at the peak of his/her 


occupational career. 


6. Withdrawing (Over 70). Contemplating a productive and 
responsible life. The individual has retired from work and looks 


back over life with satisfaction, sees that he/she has made a 
social contribution, and is pleased with it. 


Using the Havighurst model as a basis, counselors can organize ac- 


tivities relevant for stages of vocational development expected to occur, and 


they may trace progress of clients through career development stages and in 
terms of accomplishment of specific tasks within each stage. They may learn 
to control and enhance the quality of experience in each stage through 
Ordered activities. And if the work is documented, they may learn to demon- 


strate how vocational development is furthered by the guidance program. 

A more general developmental model is provided by Blocher (1974, 
PP. 65-87). Stages described in Blocher’s model are: organization; explora- 
tion; realization; stabilization; and examination. These stages are loosely 
associated with chronological age, and developmental tasks associated with 
each stage are described. Blocher’s model also may be applied in a wide 


variety of counseling situations. 
Use of a model such as the on 

to direct work with counselees as WE 

Viduals and groups throughout the peri 


es cited above provides order and focus 
II as longitudinal study of both indi- 
od of interest to the agency. Nothing 
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said here, however, should be interpreted as a recommendation that any of 
the above-cited models be used. Choice of an existing model or develop- 
ment of an agency-specific model is a matter for those who conduct the 
activities of the agency. 

No matter what model or theory is used, procedures developed to 
answer the question above—both in the general sense and in terms of each 
individual—are critical. These procedures are essentially counselee ap- 
praisal procedures. The quality of everything that follows depends on the 
quality of the appraisal system developed. As Allport (1937) has put it: 


(The psycholo 
he will descri 
that his coun. 


gist) will strive to be scientific in the true sense of the term bec ause 
be his subjects before he takes any action .. . and he will realize 
sel will only be as good as his data ++. permit. (pp. 95-96) 


What counseling and guidance Procedures will be utilized to assist 
counselees' development? 


Developmental Procedures begin with description of counselees at the time 
they I i 


8. Longitudinal study data begins at this 

needed to pursue adequate longitudinal 
rough implementation and documentation of sound 
es appropriate for the objectives of the agency and the 


point also, and Virtually all data 
study can be obtained th 


Counseling procedur 
needs of its clients. 


John W. M. Rothney, in his most recent book, Adaptive Counseling in 
Schools, has said that large-scale long-term studies may well be left to 
universities and other agencies that have necessary research resources 
(Rothney, 1972, p. 158). Yet perhaps no one has done more than Rothney to 
ship between actual Counseling and guidance pro- 

f d for longitudinal study. His 

al studies was to initiate practi- 
al schools, and then to observe 


and community members were 
local youth, how a program ol 
devised and delivered to assist 


program. 
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The study continued for five years through the twelfth grade. A follow- 
up study was conducted until eighteen months after graduation to determine 
whether those students receiving counseling experienced better educational 
and vocational development. 

A second book, Guidance Practices and Results (Rothney, 1958), con- 
tains a report of how counseling and guidance programs of the kind that 
were, or could be, carried on in local schools were initiated in four school 
systems where they did not previously exist. All efforts were made to approx- 
imate procedures that were feasible in schools. Students who took part were 
followed up until 10 years after high school. 

In each of these research reports it was demonstrated that data needed 

for longitudinal study of counselees are generated by the counseling proce- 
dures employed, and by the counselors and counselees who participate. It 
was also shown that these data may have both immediate implications for 
Counselor practice and later value for longitudinal study of counselee de- 
velopment. 
f The basic model described in both reports involves five steps: (1) defin- 
ing objectives of the counseling program; (2) devising appraisal procedures 
whereby counselee problems and progress with respect to the objectives 
may be assessed; (3) implementing a program of activities to further coun- 
selee development in the direction of the objectives; (4) documenting ac- 
tivities and their effects on counselees; and (5) follow-up. N 

If longitudinal data are to be adequately developed, Step 4 is critical. 
All activities clearly aimed at counselee development must be documented, 
and effects on counselees must be assessed. This step actually has both 
Immediate and long-range utility. The immediate value is that both coun- 
selor and counselee must attempt to record the meaning of a particular 
Procedure at the time it is implemented. The act of recording the procedure 
May be utilized as a way of assisting the counselee to organize his or her 
thoughts and reactions to the experience more coherently then if documen- 
tation were not required. At the same time, the agency is provided with 
Ongoing appraisal of counselee progress, ON the basis of which next steps 
aPpropriate for the counselee may be hypothesized. The long-range utility is 
In the fact that, once documented, both the procedure and the counselee 
developmental pattern are subject to accurate study at some later time. 


What criteria will be used to assess counselee development? 
y grows are developed th rough 


When the data from which longitudinal stud \ velc ugh 
tion of what criteria to use is of 


Counseling and guidance activities, the ques 


FIGURE 7-1 Documentation of a Vocational Guidance Activity 
and Examples of Counselee Reports 


UNIVERSITY OF WISCONSIN 
Research and Guidance Laboratory 


Career Visit 
Name _ Bernard W, _Date October 19, 1976 
Name of Professor _Mre Jones u 
Office Address 3321 Sterling 
Professional Field Physics 


In what specific area of this field are you most interested? Nuclear 


Phys 


Please comment on your impressions of the visit: 
No. 1: (Bernard) 


“The visit and interview | had with Mr. J 
as to the Physics fi i 


after an interview with a Professor of Law) 


The interview was one of the i i t. | 
Most informative - ave spent. 
learned that the law profession isn't ne ee 3 


arly as crowded as | had heard. He 


i was valuable to i N e 
ideas | had been developing.” me because it helped me to crystallize som 
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No.3: (Gladys, after an interview with a Social Worker) 


“| was favorably impressed by my interview with Mrs. C. | felt that she knew 
her field very well and gave me some of the answers | sought. 

“She had graduated from Miami University in Ohio and told me about its 
program in Social Work. She felt that there, as almost everywhere, the first 


step to becoming a Social Worker was the acquiring of a B.A. in sociology, but 
that to get good jobs and be proficient a master's in Social Work was required. 


“She also outlined some of the things she had done, such as working with the 
Urban League in Chicago and as a case worker. She told me which she liked 
best and why, and the things | might be expected to do in the various 
branches of Social Work.” 


No. 4: (John, after an interview with a Physician) 


“The interview itself was interesting yet not that informing. The doctor 
seemed either pressed for time or not very interested in relating his knowl- 
edge of the medical field. | asked questions and he answered them reasona- 
bly well with little or no elaboration. | didn't have many questions, so the 
interview didn't last very long. | enjoyed it yet | don't know that it was that 


beneficial to me.” 


No. 5: (Morton, after an interview with a Math Researcher) 
“After freezing while walking to Van Vleck Hall, | had to clear ‘security’ before 
my professor could be reached. Finally, | entered his office and spent most of 
the ten minutes discussing college math courses. 


“Comment on the discussion—valuable, but the professor was unprepared to 
meet me". 


both immediate and long-range concern. Just as it is necessary to describe 
the counselee at the outset, it is necessary to trace the counselee’s develop- 

Ment throughout the course of counseling. Activities and procedures are 

ased, at any given point, on what is known about the counselee. What do 
we look at to determine counselee progress? . ; 

_  Criteria are to some extent defined by clear statements ot agency objec- 
tives and by the procedural model employed in the counseling program. 
CRITERIA BASED ON SPECIFIC PROCEDURES. A simple example or two 
May help illustrate how longitudinal data are extracted from the activity 
itself, and how the criteria used to trace development are drawn from the 


Objectives served by the activity. 


214 THE COUNSELOR AS RESEARCHER 


At the Research and Guidance Laboratory, University of Hera 
(Rothney and Sanborn, 1966), a longitudinal program has been en m 
for a number of years to develop and demonstrate counsel ing and guic ; sg 
activities appropriate for high ability high schoolers. One objective s i 
Laboratory is to help students learn the things they need to know cena 
Career Opportunities, and one of the activities carried on to serve this ae er 
tive is a program of direct interviews with persons who are actually engag! 
in careers of interest to the students. 

Students are asked to state career fields of most interest to them. Taen 
an individual appointment is arranged for each student with a person = 
involved in the field of current interest. After some brief training in how 
conduct a career interview, the students go to their respective resource 
person and carry on the interviews, or in some c ) x 
more days “shadowing” the person on the job. We are interested in a 
ing whether this program is helpful to the students in learning some of th 
things they need to know about careers. 1 

As a simple follow-up activity students are asked to give written a 
tions to the visits. In different situations these reactions could be written sd 
oral, and the assignment could be highly structured, semistructured, or un 
structured, but reactions should be obtained and recorded from every coun 
selee who participates. The assignment serves three purposes: (1) it a 
the counselee to Organize and report his or her thoughts about what i 
learned; (2) it furnishes longitudinal data; and (3) it provides implications t0! 


follow-up activities, program changes, and long-range criteria for determin- 
ing individual development. 


Figure 7-1 con 
document career vis 


r 
ases they may spend one 0 


tains an illustration of one simple assignment used to 
its, together with several examples of actual counselee 
een from the examples in this figure that a wide variety 
result from the same procedure. On the basis of a large 
such as the above we may determine that: 


1. 


2. Some resource Persons, even though they say that they are 
interested, should be deleted from the list of people to whom we 
reter Counselees, 

3 
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4. In general, the procedure is worth doing, since it promotes for 
many counselees the kind of knowledge we are interested in. 


Thus the reaction assignment serves as a small thought problem for the 
counselee concerning how he or she profited from the visit, and at the same 
time it furnishes us with evidence of what happens because we carry on the 
program. In later years we may determine if actual career choice is related to 
the program, since basic data we need to discover this is now recorded. 

The examples given in Figure 7-1 involve only counselee testimony. If 
more “objective” evidence of the effects of career visits were desired, an 
instrument could be developed to assess what kinds of facts can be reported 
by counselees as a result of having participated. 

Another example is drawn from the attempts of the Research and 
Guidance Laboratory counselors to systematize parent contacts. After con- 
siderable experience in working with parents, a guide to parent conferences 
was devised (see Figure 7-2). The guide was developed as an aid to coun- 
selors in working with parents to attain the following goals. 

© To inform parents about characteristics of their children that they 

may not be aware of. 
© To stimulate action of parents to meet developmental needs their 
child shows. 


© To facilitate communication between the parents, the school, and 


the student. 


and other parental characteristics that 


© To discover points of view 
p ino, and Wunder- 


affect the student's development. (Sanborn, Pulv 

lin, 1971, p. 2) 
Criteria for examining parental involvement in the student's life, then 
and in the counseling program, are: 


hild. 


e Increased parental understanding of their c 


© Parental action taken in the interest of serving counseling objec- 
tives. 
© Parental understanding of the counseling program and its objectives 


as recorded in conference records. 
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icipati ent 
e In the long run, effect of parental participation on the developm 
of the student in areas of concern to the Laboratory. 


The left side of the form shown in Figure 7-2 (“Counselor's ig eal 
dations”) is completed at the time the counselor is working with ope 
selee. This may be done solely by the counselor, or it may be done jo ite! 
with the counselee. When completed, it becomes a basic guide to use W 
conducting the parent conference. 


FIGURE 7-2 Documentation of a Parent-Counselor Conference 


PARENT-COUNSELOR FORM 


p i SS 
Name of Student Jchn Grade _ 1 _ 


Date of Parent Interview: et 


Date of Student Interview 
Counselor Smith 


Attended Parent Conference: Mother only ( ) Father only ( ) Both (m Other( ) 
If other than parents, explain: 


The following topics are often cov 


s i may 
ered in parent interviews. Any one may OF 
not be considered at any session 


‚ and others may be added: 


1. Work and study habits 


7. Choice of post-high school educa 
2. Choice of subjects tion 
3. School activities 8. Financing college 
4. Community and church activities 9. Reading practices 
5. Use of leisure time 10. Test interpretation 
6. Occupational choice 


m 
11. Nature of the Laboratory progra 
12. Part-time employment 


Counselor's recommen 


1 dations for dis- 
Cussion with parents: 


Parent's remarks and reactions: 

1. Consider choice of 1. Was topic discussed? (xyYes ( Dan 
may be determined b Much discussion of this matter. eer 
ents took notes and said they W 


: dis i ith John. 
State. If Engineering, will go to U. of BE 

N of elements in- 
volved in each choice. 
2. If John will asse 


drawing and archi 
can be submitted 


mble his work in 2. Was topic discussed? (x)Yes ( I 
tectural drawing, it Specific plans were made for a g 
to an expert in this on which they would encourag 
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_ The right side is completed at the time of the conference. Any topics 
discussed not originally on the guide are also recorded. Parents’ reactions, 


points of view, and stated intentions regarı 


ding any of the topics are recorded 


briefly immediately following the conference. 
By checking back at a later time with parents, their children, or others, 


it is possible to determine whether any a 
conference. Since the original transaction 


ction was taken as a result of the 
has been recorded, this follow-up 


can be done accurately. Research on the effects of parent conferences where 


field to get his or her judgment and 
Suggestions. 


3. John seems to be an excellent 
selection to be first student in this 
School to do an independent study 
Project. Would parents support 
idea? Explain to parents what is in- 
volved. 


4. In view of father’s recent illness is 
there special need for financial as- 
Sistance? In any case inform parents 
of Steps necessary to seek scholar- 
ship support, and loans if necessary. 


5. Suggest that John consider joining 
book club. He tends to narrow down 
his reading to science and may need 
to explore other areas. 


Additional counselor comments: (Note p 


aati 
Ction on any area so that a check cal 


P : 

ah Vitally interested. Seem 

m mother is somewhat concern 
any activities. 


John to assemble his work. It was 
then promised that the counselor 
could help to arrange a time for a 
conference with an architect. This 
had been discussed with John and 
he agreed to do so. 


. Was topic discussed? (x)Yes ( )No. 


Parents had some doubts about 
whether John would have time but it 
was suggested that the indepen- 
dent study would be substituted for, 
not added to, his regular work. They 
said they would discuss it with 


John. 


. Was topic discussed? (x)Yes ( )No. 


They will fill out financial aid forms. 


. Was topic discussed? (x)Yes ( )No. 


They thought this was a fine idea. 
Have many books at home but John 
is very selective in choice. They were 
concerned that he was narrowing his 
reading too much and would encour- 
age him to try the book club for at 


least one semester. 


articularly if parents promised to take any 
n be made the following year.) 


ed to be in agreement on all matters considered 
ed about John’s tendency to get involved in too 
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this form was used have led to implications as to how ne a 
approach parents on topics where parental action is ae ( en 
Rothney, 1970; Henjum and Rothney, 1969; Jessell and Rothney, er 
Later, when we are interested in the more long-range questions rela a 
to Laboratory goals for human development, we have a record of atte 
involvement and can obtain from parents and counselees evidence sit a 
ing the impact of parental activities on the experiences and developmen 
the counselee. Furthermore, systematic involvement of the parents in € if 
rent activities paves the way for securing their cooperation when Ip 
or follow-up data are needed. This gives an advantage to those who a 
secure 100 percent follow-up returns from a population or from a repres 
tative sample of that population some time in the future. d 
These two examples have shown how objectives, procedures, an 
criteria are interrelated in the formulation and conduct of longitudinal a 
So long as the study can be related to specific goal-oriented experiences an 
outcomes, then the data are of immediate interest. So long as each activity 
documented is related to long-term goals, then the data are of long-term 
interest. Criteria in either Case are specific to the activity being documented. 


i t 
LONG-RANGE USE OF A SPECIFIC PROCEDURE. Two related studies aa 
were carried on over a seven year period may serve to illustrate the relatio! 


ship between immediate and long-range use of criteria, The first study (San- 
born and Niemiec, 1971) was ana 


of counselees could be used to gai 
to be related to career choice. T 
including the content of personal 
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tance in later years than they had while the individual was in school. Thus, 
the follow-up may enrich our understanding of immediate data. 

The criteria used in the first study were matchings of value hierarchies 
obtained by direct and indirect methods. In other words, the research estab- 
lished that the things subjects said about their values in a direct structured 
interview, and the things their counselors said, could be verified by study of 
four-year cumulative records of things they had said and done in the past. 
That is, it would be possible to assist counselees in value clarification by 
using existing appraisal data. The criterion for the second study was match- 
ing of the original value hierarchies with those obtained by direct structured 
interviews seven years later. In each case the criteria were specific to a 
Particular counseling activity, and to a particular issue in career develop- 


ment of young people. 


CRITERIA REFLECTING GENERAL AGENCY GOALS. Long-range criteria 


are often related more to global objectives of counseling than to one specie 
activity. When this is the case, criteria may be more difficult to establish. 


Ultimately, the selection of such criteria involves operationalizing concepts 
ee objectives of counseling. If we take the broadest view, our 
E jectives are as broad as life itself, and this would be reflected in the 
vu de selected. It is necessary to determine what constitutes desirable gen- 
Outcomes of counseling and what criteria can be used to assess them. At 
ifferent times by different researchers a wide variety of criteria have been 
employed. Travers (1960) grouped these criteria into two general categories: 
Subjective, for example: 
Personal happiness 
Satisfaction with status 
Satisfaction with vocational choice 
Sense of social adequacy 
Satisfaction with counseling received 
Objective, for example: 
Improved achievement 
Personal adjustment 
Emotional stability 
Occupational choice 


Social adjustment 
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In assessment of any of the above, many types of measures have been used. 

There are certain difficulties associated with assessment of any of the 
long-range criteria thus far utilized. Most subjective criteria, for example, 
involve securing testimony of clientele but it may be difficult to substantiate 
this testimony. Misinterpretations, exaggerations, understatements, and de- 
liberate or unintentional deceptions can occur. Furthermore, testimony on 
such factors as happiness or satisfaction with status may be transitory. A 
respondent may be happy with his or her status one day, but not the next. 
Satisfaction with counseling received does not suffice either as evidence of 
the effectiveness of the process or as evidence of counselee development. 
Leona Tyler concluded after a survey of research based on client satisfaction 
that clients like counseling by approximately a three to one margin. She 
observed that “the same sort of evidence can be obtained for the success of 
fortune-tellers, phrenologists and faith healers” (1969, p. 218). 

Objective criteria have limitations too. In studies of school and college 
counseling, for example, academic achievement, as reflected by class 
grades, has often been utilized as a criterion of student development oF 
counseling success; but use of this measure rests on the assumption that 
getting good grades reflects healthy adjustment or development. This is not 
necessarily true. Assessment of emotional “adjustment” or comfort involves 
a similar difficulty. At least one theorist (Dabrowski, 1972) asserts that emo- 
tional upset precedes positive development. Furthermore, assessment of 
“appropriate’’ vocational plans requires some knowledge or judgment 
about what is a social factors may be culturally or 
ifficult to judge in terms of appro- 
‚ for example, concluded that the guidance pro- 
d improvement because the proportion of high 
evel vocational aspirations was more than twice 
: of the existing work force actually engaged N 
professional level occupations. Only in retrospect could it be discovered 


up all counselees who grad 
things, we are interested in 
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seling and guidance activities to their vocational choices and achievements. 
We ask the following question, among others, on a printed questionnaire: 


Check below the response that best reflects your attitude about high 
school counseling and guidance activities you took part in for the pur- 
pose of choosing an appropriate vocation: 


() very helpful 
() helpful, but not enough 
() of very little help 


( ) did more harm than good 


When all the questionnaires are returned, we find that we have responses to 
this question from Bernard, Henry, Gladys, John, and Morton (see 1967 
Career Visit comments included in Figure 7-1). If the senior career visits 
were the only career guidance experiences these persons had while in high 
school, we might speculate that they would answer the above question 
differently from one another. Because we have data from the 1967 activity, 
we may also speculate why each person answers as he or she does. If other 
Career guidance and counseling events took place during high school, and if 
these have been adequately documented, such events can be taken into 
account in evaluating the meaning of the follow-up responses. Although the 
Question yields only subjective data, we may find it possible to support the 
data by means of both subjective and objective data from the past. Reasons 
for expressed satisfaction or dissatisfaction may be hypothesized, and factors 
related to current viewpoints may be traced. 


When do we cease to assume significant influence of counseling? 


If we look at broad goal statements made by various leading writers in the 
field, they seem to bear the implication that if we are to look for counselee 
evelopment in terms of broad goals, we must do so for some time into the 


Uture. Consider the following examples: 


The purpose of counseling is to help people to become self-sufficient and effec- 
tive problem solvers. (J. D. Krumboltz and C. E. Thoresen, 1969, p. 209) 


The development of a reasonable independence in a client who takes responsi- 
bility for himself, his behavior, his choices and decisions, and his values and 
goals. (C. H. Patterson, 1962, p. 13) 
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We will be working with you, your parents, and your teachers over a period ef 
years to see if we can help you to understand yourself better than you na 
might, so that when you have to make important decisions you will be be 
prepared to do so. (J. W. M. Rothney, 1972, p. 54) 


Assist the student to choose and make progress towards educational and nea 
tional objectives which will yield maximum satisfaction . . . and aid the stu 


to set his aspirations in terms of his potentialities. (E. G. Williamson and E. S. 
Bordin, 1941) 


Such words and phrases as “self-sufficient,” "effective problem sol- 
ver,” “independence,” “takes responsibility,” “make important decisions, 
and “maximum satisfaction” all seem to refer to characteristics that coun- 
selees would manifest in some durable way after counseling has poner 
Although perhaps no agency retains its counseling relationship with the 
typical client long enough to view the “finished product,” any serious at- 
tempt to describe the impact of counseling on persons must involve some 
determination of whether directions established during counseling are pur- 
sued after counseling. But how long can we realistically expect to secure 
meaningful data from past clients? : 

Rothney (1963) illustrated that the intervention of time, with its con- 
comitant cultural change, introduces difficulty in establishing relationship 
between counseling and later life. : 

A recent study by Hartz (1973) has shown that a number of client 
variables of interest to counselin 
the historical context i 


widely dispersed geographically than their 1951 
counterparts. On subjective criteria they reported different reasons for 
choosing their vocations; they were more ambivalent regarding their current 
status; they were less satisfied with previous education and counseling; and 
they were less satisfied 


l with their experiences during the first 10 years after 
high school than were the 1951 subjects. 
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priateness should have changed. What does it mean, for example, if we 
discover that in current time persons are more often deciding not to marry 
within ten years after high school graduation; or to marry ata later time? 
What does it mean if we discover that they are less satisfied with their 
Current status, or have less confidence in their career choices than has been 
true in the past? What are the implications for counselors? These are the 
kinds of questions that can be raised by studying progress of counselees over 
a long period of time. . 

Perhaps there is no general answer to the question of how many years 
follow-up should be carried on beyond termination of counseling. Each 
agency must determine its own answer, based on its own objectives. How- 
ever, a universal policy should be that when agency goals involve counselee 
development beyond the time when the counseling is done, study of clien- 
tele beyond counseling is indicated. Serious study of follow-up data is al- 
Most certain to stimulate new thinking about the appropriateness of agency 


goals and procedures. 


DEVELOPING A 
LONGITUDINAL 
RESEARCH PLAN 


In describing a model for longitudinal research we will emphasize 
documentation of counselee development related to or concomitant with 
Specific agency activities. It is probably obvious to the reader by this time 
that we advocate the process of defining specific objectives (within the limits 
of long-range goals of the agency), implementing activities designed to meet 
those objectives, and incorporating into each activity a means for recording 
What transpired and what was accomplished. This is done activity by activ- 
ity. In the long run, data on general agency goals will be the result. In the 
Meantime data on current counselee experiences and reactions will accrue. 
There are only a few basic principles which, if adhered to, greatly 
facilitate longitudinal study of counselees. These same principles facilitate 
Current work with counselees, since they have the effect of providing focus 
Or current contacts and stimulating both counselor and counselee thinking 


"egarding the meaning of counseling experiences. 
Concentrate on Agency Goals 


We have already discussed the advantage of specifying the general counsel- 
Ing goals of interest to the agency. We have discussed also the advantage of 
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using some theory or model whereby developmental phenomena can be 
classified. Once these have been at least tentatively accomplished, they 
provide guidelines for the kinds of activities to incorporate and the kinds of 
data needed for tracing progress. 

At the University of Wisconsin Research and Guidance Laboratory, for 
example, general developmental goals include: (1) assisting counselees to 
learn about their own abilities, interests, values, and motives, especially a5 
these are relevant to choosing careers and setting life directions; (2) assisting 
counselees to learn about and take advantage of developmental, educa- 
tional, and career opportunities open to them; and (3) assisting parents and 
teachers in providing counselees with appropriate experiences related to the 
above. All activities generated by the Laboratory are designed to serve one 
or more of the above objectives. All records kept in counselee cumulative 
files are obtained during the course of the activities themselves. 

As might be expected when working with thousands of young people 
Over a number of years, Laboratory counselors become involved in a wide 
variety of “problems” or “crises” in the counselees’ lives that are brought to 
the attention of the agency by the counselees and not by means of systema- 
tic agency procedures. These matters are not recorded and are not incorpo- 
rated in gross longitudinal studies, because they are usually not relevant to 
any of the agency goals. Over a Period of years, for example, the staff may 
unwanted pregnancies and provide advice 
ed; but no attempt is made to document and 
of agency objectives, Instead, longitudinal 
ositive development in areas of general in- 


women in reaching 
do about unwanted p 
procedures utilized in working 


: Ess eveloped. Until these have been sys- 
tematized, however, It is suggested that existing agency goals provide the 
limits for longitudinal data collection 
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Document all Relevant Activities 


Any activity carried on by the counselor with the counselee, or any activity 
the counselee becomes engaged in as a part of the total counseling process, 
should be documented. The only exceptions would be activities not ger- 
mane to agency goals. Ideally, the documentation process will include some 
Provision for the persons involved in an activity to report their evaluative 
reactions at the time the activity takes place or immediately afterward. Fig- 
ures 7-1 and 7-2 contain examples of brief methods for documenting 
specific activities. In each case the method is designed to record who was 
involved, what transpired, when, and, from the viewpoint of the recorder, 
what results were experienced. Once these things have been recorded it is 
Possible to check viewpoints of others involved, if desirable, or to follow up 
at a later time to attempt to determine effects of the activity. 

Documentation procedures need be neither lengthy nor laborious. 
Most of the time they can be completed by the recipients of counseling 
rather than by agency staff. The immediate effect is to encourage partici- 
Pants to think about what has happened and what importance, if any, the 
activity has for them. In the long run it is possible to review accurately the 
activities of the agency with any given counselee, group of counselees, or 
with other persons who participate in the counseling process. 


Use a Variety of Data Sources and Types 


Some of the data necessary in longitudinal study of client development can 

Come only from the counselee. Some may best be obtained from the profes- 

Sional viewpoint of the counselor. Often the best source is a "significant 

Other”— parent, teacher, spouse, or perhaps a clinical resource person. 

Usually no single source is adequate, and information on a single issue must 
© obtained from several sources. Data that are all obtained from a single 

Viewpoint—say, the counselor’s—on the basis of a single activity, such as 
€ interview, are not likely to appear substantial over time. 

It is usually possible to secure both objective and subjective data con- 
cerning counselee development, and both types should be sought. If, for 
example, a counselor has suggested to the parents of a counselee that a 
Certain action should be taken by them, it is one thing to secure their 
reaction to the suggestion, but quite another to discover what action the 
Parents actually take. It is yet another to try to assess effect of the action on 
ee Counselee. It may be desirable to get some testimony from the counselee 
erdibg the effect; but if some learning goal was intended, some way to try 

assess what was learned is also needed. 
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A potential effect of involving all functionaries in the un 
process is that all of them may understand better what the counseling a 
cess is intended to accomplish and what kinds of progress are being mi = 
Later, if asked to recall their own roles in a particular activity and to rela 


5 ; n- 
the activity to a current situation, they may be better able to provide mea 
ingful information. 


Specify Data Sources 


Any instrument used to document a counseling activity should be designed 
to secure exact information regarding who was involved, when the activity 
took place, where, who is completing the report, and what techniques were 
used to secure information, as well as any special circumstances of note. 
Any of these factors may be essential information in understanding the 


lee Fr r 
significance of an activity, and any of them may be necessary at some late 
time if follow-up information is desired. 


Provide for Repeated Assessments 


In order to derive a developmental picture it is necessary to secure repeated 
assessments over time, of the phenomena of interest. Whether the problem 
is to assess school achievement, vocational development, attitudes about 
the self, interpersonal relationships, self-sufficiency, or future aspirations, 
activities that yield parallel data over time are needed. 

In some instances it may t to provide for repeated assess 
ment with exactl inventory such as the Adjective 
Check List ( ), for example, or the Mooney Prob- 
lem Check List (Mooney and Gordon, 950) may be repeated when coun- 
selee responses to exactly the same items are desired. In other instances, 
however, parallel data may be obtained using dissimilar sources. As a sim- 

may be related to later vocational 
training, to jobs actually engaged in, or to stated future plans. How repeate 
assessments are to be obtained can best be determined by the agency staff in 
terms of what information is desired and what is feasible to secure within the 
limits of agency procedures and goals. 


Revise Meaningless Activities 


It may seem unnecessary to suggest that mea 


: ningless activities be eliminated 
or revised. Yet one of the results of serious 


longitudinal study of counsele® 
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N 
N 


development is likely to be that meaningless activities come to light. Some- 
times these are activities that have long been engaged in and subscribed to 
by agency staff. It may be discovered, for example, that no relationship can 
be established between results of a certain vocational interest inventory 
administered during counseling and actual vocational choices made by 
counselees at some later time. When this becomes obvious, either the inven- 
tory or the way it is used in counseling should be questioned. Or it may be 
discovered that a certain activity designed to elicit action on the part of 
counselees or significant others seldom or never can be associated with 
actions desired. When this is the case, the activity should be changed or 
eliminated. It may be learned that a certain procedure does not lead us to 
any understanding of how individual counselees differ from one another. 
We may, for example, administer a certain mental test to a number of 
counselees only to discover that there is little or no variability of perform- 
ance, or we may ask a certain question on a follow-up questionnaire to 
Which virtually all counselees respond alike. If so, then we may eliminate 
the measure unless there is some compelling reason to identify the few who 
deviate from the many. . 

j In longitudinal study as well as in counseling, the primary reason for 
identifying and eliminating meaningless procedures is to economize on time 
and improve competency. Time is probably the most expensive commodity 
in counseling, and time probably vies only with competency as the com- 
modity in shortest supply. Both commodities may be enhanced when 
uselessness is eliminated. In general, there are perhaps three indicators that 
an activity may be meaningless: (1) no relationship between the activity and 
developmental phenomena of interest to the agency; (2) no change in be- 
havior of counselees or significant others as a result of the activity; (3) no 
Meaningful variability in the data yielded by the activity. If any one of 
these indicators is present, then the activity should be questioned. 


Secure 100 Percent Response 


If data collection procedures are routinely built in to counseling activities 
Carried on by the agency, then longitudinal records can be developed con- 
Cerning the total population of counselees during the time they are involved 
'N counseling. Ideally, the study of these data would involve the total popu- 
ation. For certain purposes, however, it may be neither feasible nor neces- 
Sary to work with the total population. Instead, a sample can be identified, 
with due care taken to ensure that the sample can be defended as represen- 
tative of the population under study. 

A number of sources are available that contain descriptions of sound 
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sampling procedures (e.g., Hillway, 1964, pp. 195-199; Wallen, 1974, PP- 
84-110). Here we shall stress only that once a sample has been identified as 
representative, data from some proportion of that sample is not necessarily 
representative. It is especially true in follow-up studies that researchers often 
encounter difficulty securing returns from all members of the group under 
study. No matter how respondents can be shown to resemble the non- 
respondents, they differ systematically in that they responded. The meaning 
of this difference is a matter of pure speculation. Therefore, it is important to 
secure data from all members of the group. 

Experiences at the Research and Guidance Laboratory have led us to 
believe that if during the course of counseling the counselees have regularly 
participated in the longitudinal study process, their participation in post- 
counseling follow-up is easier to secure. Whenever counseling activities are 
documented, it is probably useful in the long run to discuss with counselees 
or others who furnish the data how the information is being used at the time 
and why the data they furnish are important. It is also desirable to inform 
them that the agency will probably be contacting them in the future to find 
out their current status and some of their thoughts about the counseling they 
received. If these things are done at the time the agency is serving the 
counselees, the likelihood may be improved that at some later time the 


Counseie will recognize the importance of the information they can sup- 
ply. 


Analyze Both Case Data and Gross Data 


are necessary to 4 
Methods used in developing an 
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adequate case study are presented by Rothney (1968) together with several 
examples of case studies of school and college age persons. R. W. White 
(1961) has provided excellent long-range studies of “normal” persons with 
complete discussion of case study methods he used and applications of case 
data to theory. Amble and Bradley (1973) illustrate, among other aspects, 
the effects of differing viewpoints on the interpretation of case data. Study of 
these three sources should provide the reader with a keen sense of humility 
regarding generalizations about people, an understanding of the uses of the 
case study in counseling, and some knowledge of useful methods for case 
research and analysis. 


CONCLUSION 


Longitudinal study of counselee development should be regarded as an 
essential feature of any agency where counselee development is a goal. 
Systematic longitudinal study is useful not only for understanding long-range 
developmental phenomena of interest to the agency, but also for making 
current decisions about counseling practice. The primary advantage of lon- 
gitudinal study is that it provides data necessary for both immediate and 
long-range evaluation. These data can be used to answer questions about 
Populations or specified target groups of agency clientele, or they can be 
used in systematizing knowledge of individual cases. 

Longitudinal study can be implemented in a counseling agency as a 
routine feature of the counseling activities regularly carried on. The initial 
task is to develop systematic documentation procedures whereby agency 
activities with counselees can be recorded as they occur. Documentation 
should include a record of who was involved, what transpired, when, and 
what effects of interest to the agency and/or the counselee were experi- 
enced. The kinds of activities to be documented, and the kinds of effects to 
be recorded, are those pertaining to the general counseling goals of the 
agency. 

The process of gathering longitudinal data need not be laborious or 
time-consuming. Actually, a well-planned documentation procedure may 
save time or enable agency staff to utilize time more efficiently than it 
otherwise would. Figure 7-2 illustrates how a method for planning efficient 
use of parent conference time doubles also as a documentation procedure 
feeding into the data on activities and consequences for counselee de- 
velopment. Figure 7-1 shows how data may be obtained from the counselee 
in the form of a brief record of his or her own reactions to a vocational 
8uidance procedure. In each illustration, efficiency may be improved 
through organization of thinking and planning of the counselor or coun- 
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selee. An inventive counseling staff may produce a variety of simple ern 
dures such as these that tend to help them organize current er ie . 
efficiently, keep counseling activities focused on counseling goals, and a 
the same time furnish longitudinal data. : . bë 
It is likely that most counseling activities of an agency can e 
documented adequately only if the agency staff themselves devise the pr “ 
cedures to be used. The kinds of activities engaged in, the purposes they a 
intended to serve, and the relationship of each to agency counseling go 
must be examined. Criteria for assessing consequences of each activity an 
for tracing progress of counselees must be established. The process A pa 
complishing these tasks is almost certain to generate among staff mema 
important questions about how staff time is used and what effects ough 4 
be expected of time use, Thus, even at the outset of a longitudinal er 
plan, agency staff are encouraged to think systematically about the e 
ciency of what they do. 
Later, when longitudinal data begin to 
examine immediate effects of counseling 
series of questions is almost certai 
concern whether what agency st 
can actually be defended in term 


accrue, counselors can start to 
activities. At this time another 
n to arise. Most of these questions will 
aff and counselees are spending time on 
s of progress toward counseling goals. On 
the basis of evidence, revisions in counseling procedure can then be pro- 


2 5 aha ; ‘ r 
posed. In this way systematic longitudinal data may provide impetus fo 
more economical use of agency time and resources. 
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APPLICATIONS IN FIELD SETTINGS 


CHAPTER 8 

The School Counselor 
as Environmental 
Researcher 


Roger F. Aubrey and Francis W. McKenzie 


Research, whatever its ultimate form, is basically systematic inquiry. The 
genesis, focus, and priorities of research by school counselors are deter- 
mined by the conditions, the actors, and implied scenarios of their school 
settings. To understand what research efforts ought to be for counselors in 
school settings, we first need to look at who counselors are, how they 
emerged in schools, and what ambiguities they face in role and function. 


THE “ORIGINS” OF 
SCHOOL COUNSELORS 


Throughout the country’s schools are ex-teachers who, refurbished with a 
ew courses, were commissioned at some point in recent time as guidance 
Counselors, Launched as an administrative response to minimize some local 
Pupil problems, these newly created personages found themselves confused 
as to who they were and what they were expected to accomplish. Over the 
Past few decades they attempted to supply “cures” and “solutions” to a 
road spectrum of educational problems. 
Often problems in schools were “identified” and adopted with a singu- 
‚AT sense of ownership. Targets and foci became “underachievement,” 
Passivity of the learner,” ‘‘alienation of the learner,” “lack of self- 
adjustment,” “poor study habits,” and “academic failure.” 
_ Part of the collective role problem of counselors has been rooted in 
their origins, Counseling with dubious “ancestry” in psychotherapy and the 
World of work came from outside the primary instructional family of tradi- 
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tional subject matter. Coming late on the scene gave counselors little En 
lectual or academic legitimacy in the eyes of subject-matter teachers. se 
tolerated than welcomed on the established educational turf, counse > 
were allowed to deal with the undesirable educational residue left a 
subject-matter specialists who were indifferent to all save their p 
academic areas. They were expected to control or otherwise a 
large percentage of pupils who either could not, or would not, fully dane 
in the existing knowledge-dispensing courses and sequences. In short, mee 
were expected to concentrate their efforts largely with the leftovers that A 
tradition-legitimated specialists did not, or could not, “motivate "or teac y 
Like it or not, how counselors feel about their legitimacy significantly 
affects the degree of assertiveness they take in the questions they feel they 
should or do pursue. It determines also the extent of their risk-taking in 
examining the traditions, folklore, and customs of their schools. Finally, 
legitimacy plays a major role in the sharpness of focus counselors turn on 
the psychological imponderables, uncertainties, and anxieties facing their 
students, colleague teachers, and themselves as well. ; 
“Legitimacy” is an issue of major consequence. The paradox of the 
“turf and time” Poses a distinctive access problem to their pupils. The 
literature rarely acknowledges that open access to their pupil clients is rela- 


tively denied counselors in the vast majority of American schools, both 
elementary and secondary. 


Unlike their fellow teachers 
rooms, space for teach 
Likewise, there is an 
schedules of school 
either cutting a class 
class lesson. 


‚ few counselors have had their own class- 
hing, or settings for discussions and group work. 
absence of guidance time blocks in the daily or weekly 
s. Few counselees can get to their counselors without 
Or securing a teacher's Permission to be excused from a 


$ st, teachers regard 
guidance as a somewhat mysterious and doubtful presence; a regular an- 


ay from the impor 


THE NONSTATIC 
SCHOOL ENVIRONMENT 


nvolving expectancies, 
both peer-to-peer and age 
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what different persons make it to be, and how it is perceived differently by 
those in charge, those employed by it, and those pupils “in custody,” its 
Primary consumers. 

Structurally, schools appear to be unmodifiable and unchanging. Actu- 
ally, they are in the throes of constant change, but not uniformly so. Parts of 
schools resemble themselves a decade or two previously. Some elements 
are hardly comparable to six months earlier. A school’s variability and pre- 
dictability of emphasis are more a phenomenon of collective individual 
behavior than that of policy decisions, administrative fiat, or departmental 
regulation. 

Any presumably desirable improvement in the school’s responsiveness 
to the needs of its students and teachers starts with individual concern. It is 
then transmitted in ripples and small increments until there is a cluster of 
concern whose collective voice can get attention. Eventually, this results in 
Sanction to move from unofficial concern to official concern, and from there 


on to study or investigation. 


Today's Student 


Collectively, students today are a vastly different aggregation of young peo- 
ple than those who preceded them, even a half-generation ago. They enter 
School earlier (early education programs, day care and nursery programs); 
they are also older (mandated special education programs to age 21, junior 
College and post-high-school technical programs). Such students have a 
high probability of having moved from several communities or between 
Several schools in their K-12 years. 3 tes 

A The probability of growing up in a one-parent family is fast approach- 
ing a one-out-of-three likelihood. Today’s students include drug users, drug 
abusers, and pregnant students eligible for abortions or adoption arrange- 
Ments, 

Services and institutional programs of federal and state agencies, 
clinics, detention centers, as well as specialized schools for the handicap- 
Ped, the blind, deaf, mentally retarded, and the crippled are being closed or 
reduced at an unimagined and unanticipated rate. 

Students who did not enter school, enter; those who did not stay, stay; 
and those who can hardly function are now politically positioned to ‘‘func- 
tion.” Neither “average,” “typical,” nor “predictable,” today’s pupils are 
Everyone’s children, with the full spectrum of needs and problems. With 
vastly broader and unique needs, the schools, however unready, have to 
Sear up rapidly for new demands and new kinds of effectiveness. 
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THE RESEARCH ROLE 
OF THE COUNSELOR 


Whether the only pupil personnel worker in a school, or one of several, the 
counselor is the only generalist. It is therefore inevitable that he or she is the 
one to whom most constituencies press their concerns or demands. Coun- 
selors are obviously almost hopelessly overextended with far fewer fingers 
than the ever growing holes in the dikes call for. If for no other reason than 
achieving some semblance of personal and professional effectiveness, coun- 
selors must initiate inquiry, obtain data, assess situations and persons, and 
enter into problem-solving and decision-making arrangements with others. 
Obviously, goals, objectives, strategies, and programs are necessary. TO 
move to this level of function, counselors need a basic research stance to 
determine what is functional, what is dysfunctional, what is effective, what 
is ineffective, and, most especially, what are the priorities for their time and 
capabilities. 

Kehas (1975) has succinctly outlined the counselors’ aversions to both 
research and notions of research. He sees counselors as identifying research 


research” identified as an incongruity if not 
n experience. 

counselors that such perceived threats can 
research to be treated as hypotheses, not 
with individuals” (p. 46). He further elabo- 
enerally encouraged research from within, 
atically investigated questions about er 
have not become the ee a a these: questions ee 


i of actual inquiry, and (d) that others, usually 
outside agencies and graduate institutions who live on research, as a result, 
4 De researched an important 
questions. d what are the imp 
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tially valuable colleague, eager to become an effective advocate for stu- 
dents, the counselor usually has not yet been established. 

The stronger the counselor's image of advocacy is perceived by others, 
the greater the possible suspicion that they (teachers, parents, principals, 
etc.) are the targets. If they come to see the counselor as moving in on 
grounds and issues not in their own interest, all kinds of countervailing 


behaviors can be expected from them. 


Obtaining Sanction 


An astute counselor-researcher who wishes to survive initial relationship 
booby traps wisely decides to be neither a lone performer nor a “star.” 
Mature examination of local circumstances usually suggests that there exist 
sufficient concern, frustration, and desire for improvements in all the mem- 
bership groups of public education to sanction and “authorize” some re- 
search efforts. The critically necessary first step is to help build a rationale of 
self-interest for each group’s buying into the process. Common ownership of 
topics for investigation has the potential of moving through data gathering to 
a true engagement in common cause in problem solving and problem resol- 
ution. In fact, little that will be useful can be accomplished without such a 
support base. Otherwise, opposition, in some form, is a predictable out- 
come, 

Acceptance of a counselor, particularly a counselor who questions and 
seeks answers, is highly dependent on the recognition of the usually present 
quid pro quo, namely the teachers’ implied or stated ‘What can you do for 
me?” question. If this question is anticipated and woven into broader and 
More justifiable perspectives of inquiry, partnerships are established and the 
inquiry has a broader base of authorization and support. 

In the setting of formal schooling, the counselor needs to fully recog- 
nize the internal resistances to change. Despite new buildings, special 
facilities, multimedia, special courses and the like, American education has 
remained relatively unaltered during the lifetimes of all those generations 
still alive. The illusion of change persists, as do old, repetitive, unassessed 
Practices, 


Defining a New Role for Counselors 


Counselors, unlike most teachers, are free from commitments to any one or 
More of the subject matter traditions. Students, in their varied developmen- 
tal and idiosyncratic characteristics, become the subject matter equivalents 
Or counselors. Counselors are agents provided by the institutions to assist 
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students in managing their own interests, capacities, and destinies. Peping 
students negotiate their needs within the range of school ne 
expectancies is a major expectancy role. Counselors, by now, snou d N 
divested themselves of any sense of obligation to “adjust” pupils to sc rae 
We would like to believe that counselors have gone well beyond the Hs 
timid steps of intervention and helped the institution adjust itself to 
varying and highly individualized needs of pupils. — 
As an advocate for pupils, teachers, and parents, the counselor n oe 
have eyes that really see, ears that really hear, and courage to pusun he 
why of dysfunctional behavior, the why-nots for proposed actions, an se 
inherent resistance and avoidance in all persons surrounding the educa 
and mental health tasks of pupils. vr 
Whatever the tracings of avoidances are in the counselors’ own Pas" 
the demands of the guidance role pressures playing the role of Engel 
“data-source,” “planner,” “advisor,” and “advocate” all call for a I 
involvement of intellectual curiosity and conceptual analysis on the part x 
the counselor. The customary intuitive and emotional affinities vi 
“therapist” are totally insufficient. This is not said to disparage the theraps 
tic dimension of counseling but rather to emphasize that these other trai 
and role demands call for a broader acquisition of more cognitive an 
rational competencies. , 
As a curious traveler in this educational space called a school, coun 
selors can see what others are blind to, to question the unquestioned, to ger 
out the unknown and to think the unthinkable. They can start to negotiate 


new roles and relationships beginning with those things which are Da 
staked out, or are neglected, or unanticipated by others, 


Brokering 


One can imagine the implications and consequences following the an- 
nouncement of the first schoo! 


usual courses, clock hours, s 


5 R t 
AREY Ori ieafner reso tutoring, seminars, consultations, OU 
side visitations, inside invitational visitations, pupil research assignments 
As 5- 
dents prescriptively, based on as5e® 
equa needs, and preferences. ; 
Such a school wherein guidance counselors orchestrated the matching 
i on e 
with periodic rearrangements of teach 
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resources would signal, perhaps for the first time, a real measure of the 
potential yields of truly individualized education. 

The school counselor as broker, blending needs with resources, adding 
and subtracting as needed, could truly revolutionize the whole educational 
system in favor of its two main players: pupils and teachers. 

In less ambitious and more modest terms, any such brokering of pupil 
needs that secures an improved match of instructional resources gives a 
local school a chance to opt for more desirable individual outcomes, first by 
direct exchange of pupil data, followed by fully appropriate uses of teacher 
resources, 


The Counselor as a School's Research Catalyst 


The counselor is uniquely positioned to become the pivot for data gathering 
and planning in the school. Counselors are expected to interview others, to 
have general as well as specific information, to explain, and to interpret both 
the school and the outer world. The crucial goals are to focus on more 
Significant questions, involve significant persons for the tasks, obtain a sense 
of the important, and persuade all to be willing to drop old beliefs and 
Practices in face of new information and new implications for subsequent 
behavior. 

_ Systematic and multidirectional inquiry is the counselor's best protec- 
tion from the chronic and ever present professional diseases of insulation, 
'solation, obsolescence, procrastination, misdirected energy, and ineptness. 
Although not a universal patent medicine in itself, inquiry offers a first stage 
Platform for the treatment of actual and potential ailments and pitfalls of 
Institutional health. ; a 

Our concept of the counselor as a catalyst for educational inquiry rests 
heavily on (1) the unique opportunity to serve multiple constituencies with- 
Out overidentification with any, (2) the fact that all other players (teachers, 
Students, parents, and administrators) have clearly defined and expected 
roles from which they cannot move with impunity, (3) the fact that the 
Counselors’ early-on handicap is often a distinct asset, namely, that their role 
Potentials are only vaguely perceived by others. 

The counselor's initial task is to determine what is going on in the 
School, how it matches or differs from what is expected to go on (as differ- 
ently defined by each constituency), and what should go on in terms of 
@PPropriate learning sequences and reasonable mental health goals. 
eee At this juncture, we would make the point that imaginative, energetic, 
aie a and empathic counselors are uniquely positioned to observe, assist, 

relate to teachers and pupils. 
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The Counselor’s Research As Self-Study and Accountability 


; j ffect 
Counselors are in elementary and secondary schools a 
change in the behavior of children and adolescents. As si a beach 
counselors may personally bring about development in nee ijec; 
activities as individual and group counseling, classroom guic a an by 
and curricular work. Counselors may also influence change in ir pa hee 
consultation work with other significant adults in students’ lives $ 
rs and parents. : te ee 
j of the vehicle selected by the counselor in uarie 
dents, there is a need to review periodically the effectiveness The besi 
intervention techniques and their impact on student behavior. E ll 
manner in which this periodic review can be accomplished is Sign seit 
formulating short- and long-range goals and putting them in N 
these goal statements should be linked to counselor intervention tec Si 
so a causal relationship can be established between csi fet 
techniques-goals. Unfortunately, this rarely occurs and courge air 
quently find themselves unable to account for the multiple uses of t h one 
and how this influences student development. To achieve such goa oat 
must be organized, controlled, and mobilized into priority units of p oi 
Accountability for counselor performance is the responsibility Si oul 
school counselor. In effect, this means that each school counselor sh eof 
be able to delineate time and skill utilization throughout the school E 
Further, school counselors must be able to justify the allocation of their a 
and skills in relation to clearly stated objectives for students. Without ro 
plicit goal statements, counselors are continually adrift, their time dissipa 


and unproductive, and personally faced with multiple expectations AN 
competing demands from numerous publics. itten 

Pragmatically, school counselors require a set of clear and wri mi 
objectives because of increased pressure for accountability by the jo 
paying public and school administrators, Professionally, school counse ns 
need evidence of goal attainment to validate claims that their intervention? 
actually do make a di 


R 2 g more 
fference in the lives of students. Ideally, and mine 
importantly, school counselors need hard data in order to deter” 
priorities for reaching students in schools, 


What Phenomena Should the Counselor Study? 


ive 
T aa ativ 
If counselors are to Conduct research and studies in schools, it is impera 
for them to possess a cle 


ar and concise idea of what it is they are to fir 
and investigate. Schools are notorious for swallowing up legions © 
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terested and conscientious researchers. The problem is, there are simply so 
many fascinating activities and behaviors in schools that one can easily 
become sidetracked or overinvested in relatively few areas to the neglect of 
those of real importance. 

The crucial question for any school counselor conducting research is 
how to determine what phenomena should be studied in their particular 
school setting. Should counselors focus on their immediate daily interven- 
tions with students and the effectiveness of their own skills and techniques? 
Even this simple question is more complex than it appears. In effect, if one is 
actually to study counselor practices, it is necessary to separate out the 
counselor’s behavior and technique from the actual short- and long-range 
impact on student behavior. These are really two distinct questions and lines 
of inquiry. Therefore, this question really requires observation and assess- 
Ment of both counselor and counselee in addition to a careful analysis of 
specific methodology. . ; 

In considering what phenomenon is most in need of study in a particu- 
lar school, it is obvious that a great amount of school behavior is not really 
the domain of counselors. Granted, it might be interesting to know the 
impact of administrator style on the reward system of teachers and the 
Subsequent effects on mathematics achievement in ninth graders. However, 
the pursuit of this type of research by school counselors is quite inappro- 
Priate and entirely outside the realm of significant guidance and counseling 
Concerns. 


RESEARCH AS NEEDS 
SSESSMENT AND 
ROGRAM INVENTORY 


Many counselors have found it helpful to conduct periodically a needs 
assessment in order to determine what school areas are in need of examina- 
tion. A needs assessment is actually a convenient means for identifying 
factors underlying guidance and counseling objectives. In this sense, a 
Needs assessment is a method of gathering and compiling hard and soft data 
Underlying the stated objectives of the guidance and counseling programs of 
a given school. A broadly designed needs assessment can also be a means of 
8enerating new goals for a guidance and counseling department. 
ies In devising a guidance focused needs assessment, it is desirable to 
S with broad and general categories of student needs. In turn, these 
Bories should lend themselves to a breakdown of smaller parts with 
Tr specificity. The counselor's task is to determine which categories or 
Categories are most worthy of time, energy, program development, and 
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research. In many instances, this final determination is solely in the hands of 


the counselor and the ultimate priorities will be largely influenced by local 
school conditions. 


Where Do “Needs” Come From? 


At this point, it might be well to ask where do the needs being assessed come 
from? Do they emanate from the pupil, the school, the community, the 
family, society? Do counselors have to assess all needs, much less meet 
them? Are all needs legitimate areas for counselor inquiry and intervention? 
The needs of children and adolescents stem from many sources. Coun- 
selors, therefore, must carefully examine these sources before deciding the 
merits and legitimacy of alternative requests. For example, many needs of 
children and adolescents are predetermined by schools and educators. We 
are told children have a “need” to read, write, spell, and so on. To this ale 
schools are erected and filled with audiences of pupils and educators. chil- 
dren then come to schools and their “need” to achieve is put into action. 
Unfortunately, adults fail to remember that many children are not motivate¢ 
to respond to many of the tasks superimposed by adults to “meet thelr 


needs.” If anything, many of the needs of these children are ignored or 
frustrated by efforts of the school, and the counselor is then expected t° 
“adjust’’ these students to unrealisti 


c demands, 

Other sources of potential student needs are highlighted in the findings 

of the behavior psychologists, and more particularly ¢& 

have identified a number of age and/or der 

of children and adolescents (Loevinger, 197i 

th Sigmund Freud, and extending through sub- 

an, Jean Piaget, Erik Erikson! 

ce Kohlberg, Jane Loevinger, and others, © 
ave postulated a series of universal stages 

ajority of these psychologists have identified ¢ 


: e 
al tasks and skills necessary for successful pas548 
reparation for the s 


5 
(Barker, 1968; Benn! 


berg: 
1971). Currently, for ex n, 1972; Golaen er 


on the career education b 
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because of major changes in lifetime career patterns. The same phenome- 
non of change has resulted in the past ten years in drastic alterations in the 
chemical dependence (alcohol and drugs) of Americans in general. Whether 
these are situational needs, innate drives, or reactions to stress and anxiety, 
they are certainly forces to be reckoned with. 

Finally, the profession of guidance and counseling has identified cer- 
tain “needs” in the students we serve. These include self-actualization, 
dignity, justice, tolerance, relief and release from pain and suffering, and so 
on. Counselors are enjoined to meet and fulfill such needs as part of their 
Professional responsibilities to counselees. 

The needs of the audiences we serve are therefore an amalgam. They 
represent both legitimate and occasionally suspect or questionable consid- 
erations. However, all must be examined and carefully evaluated before 
Priorities are weighted and ordered. It is at this point that specific counselor 
interventions are planned and time and energy committed to selected tasks 
and functions. 


Conducting A Needs Assessment 


The creation of a needs assessment for a particular school or school district 
can be arrived at by a variety of means. For example, if an entire school 
district wished to identify some major categories of student needs, it would 
be advisable to have a committee go about this task. This needs assessment 
Committee should have a broad representation and include students, par- 
ents, teachers, administrators, and guidance personnel. Its focus would be 
the identification of a small number of critical student needs that spanned 
the ages and/or grade levels of that school system. 

The work of the counselor on such a committee is critical and takes 
two forms. First, the counselor must endeavor to keep the perspective of the 
Committee members on a broad plane, away from the nitty-gritty. The 
Counselor’s role is to elevate discussion and dialogue so that high order 
Needs are the focal point of the committee. In accomplishing the job of 
avoiding mundane and nonproductive topics, the second role of the coun- 
Selor emerges—to stimulate the committee by actually presenting examples 
of need Categories. 

b Although a committee is preferable, a student needs assessment could 
© Conducted by a small group or an individual counselor. If this were to 
Occur, the group and/or counselor could begin determining need categories 
ei Soliciting suggestions via questionnaire or interview from students, 
€achers, and others. Another possible approach would be the construction 
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in advance of a limited number of categories by the group or an 
turn, these predetermined needs could then be sent out to intereste pe 
ents and suggestions. en N 
M “TE le probably een that a needs assessment profile is one er 
“smoking out” what a given school or department determines = ree 
student needs and how that school or department proceeds in meeting le 
needs. Figure 8-1 is a hypothetical example of one such school, nn in 
need categories represent one manner of conceptualizing student needs. 


turn, Column B is an attempt to break down the original needs listed in 
Column A into small units in order to 
Finally, 
school 


allow for easier program assem 
Column C determines, vis-à-vis action programs, where an e 
or school system places its priorities. This matching of stated y i 
with ongoing programs provides the framework whereby counselors 
order, reorder, and build program priorities. u ‘> with the 
In conducting a student needs assessment, it is critical to begin W te in 
actual needs and not the programs developed to meet these needs. a aif 
Figure 8-1, for example, the need category (under Column en 
developmental tasks and/or needs. The corresponding item in Colum 


J indicates that 
breaks this Category into subcategories, However, Column C indicates 
there are no systematic 


R i. f 5 is area 
this program deficiency must be examined. The lack of programs in this art 


ra 
ing of priorities and the Seog 
other hand, this deficiency f that 
an oversight on the part O 


RESEARCH AS 


IDENTIFICATION OF 
PROBLEMS 


ork of the cou 
social, economic, Political, 


considerations affecting stud 
Another manner in whi 
dance and counseling priori 


nselor was determined by identifying 


: nta 
educational, humanistic, and developme 
ents. 


«oh gui- 
ch counselors can determine and establish & 
ties is by the identification of preexisting P 
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lems or needs of students. Although basically remedial in nature, this type of 
research is extremely important in initially analyzing the composition of a 
given school or school district. What follows is an example of seeking out 
student needs rather than allowing the squeaky wheel phenomenon to over- 
ride reason. Although the example to follow is fictional, the process of need 
determination could be applied by any counselor to any school or case load 
of counselees. 

The Riverdale School District over the past four years has added one 
counselor to each of its six elementary schools in a concerted effort to deal 
with preventive mental health. Initially, this effort was seen as an attempt to 
identify and help young children before minor difficulties erupted into major 
academic and emotional problems. A further component of the program 
included elementary counselors consulting with teachers and assisting them 
In classrooms with a variety of group activities. 

Currently, the elementary counseling program is in serious trouble. In 
at least two schools the teachers are openly critical of the counselors and 
their unavailability for referrals and crisis counseling. In yet another school, 
the parents have become vocal for similar reasons. Strangely, .in three 
schools the teachers and parents are quite supportive of the counselors and 
Nave voiced no criticism since the inception of the program. 

Ata recent meeting of the elementary counselors, Peggy Cook asked 
the group if they would help her in gathering data to analyze the current 
Problems she and two other counselors were experiencing. Peggy felt that 
Much of the current criticism was based on teacher-parent lack of knowl- 
edge regarding the idiosyncratic character of the various elementary schools 


and their particular needs. In turn, these differences in individual school 


Makeup necessitated varying priorities and use of time and resources. How- 


ever, without data and information to justify the use of their time, the coun- 
Selors in these schools were being judged as if conditions in all schools were 
the same. In short, without some supportive documentation, people could 
Well wonder at differences in style and time usage among the six schools. 
__ The concern of the counselors in identifying critical factors predeter- 
Mining the use of some of their time and energy stemmed in large part from 
“Ome basic demographic differences among the six schools. For example, all 
of the Counselors were aware that School E contained over one-third more 
Students than did Schools A, C, and F. This fact alone meant that the coun- 
Selor jn School E would operate somewhat differently than colleagues in 
“Maller buildings. However, size of student body was only one of many key 
Ndicators determining counselor priorities. , 
As the counselors listed and discussed what demographic factors were 
Most Critical in their respective schools, a consensus was reached to study 
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P i chool 
nine factors. These factors are listed in Figure 8-2 under the nae 
Indicators. All counselors then gathered the data in their = = te Searing 
concerning each of the nine factors. These data were ta bula al the OE 
total numbers of students falling under each School Indicator nsele 
centage of the total student body this represented. In dor $ n the coun- 
drew up a demographic profile for their own schools an am profile. 
selors as a group designed an all-elementary school ei ot 

Figure 8-2 is one means of depicting some of the crucia ection it 
press upon counselors as they attempt to allocate their time and wae ard 
is readily apparent that Schools D and E stand out as institutions v re: ni 
greater need than Schools A or F. It is also obvious that ee any 
merely related to numbers or size of school. A host of factors imping ‘ges are 
institution and these must be recognized and dealt with before priorities 
established. u as 
The representation of a student body by key School mee a 
cted in this figure, can be done by any counselor for a given scho me 
simply for the total group of students assigned to a counselor. For exa a ea 
Counselor in a high school of 3000 students with an assigned load _ 
students could do such a demographic profile on just those 300 stu ject 
The resultant information may indicate that the counselor has been neg = 
ing one segment of his or her counselees or it may show that a at Ih 
tionate amount of counselor time has been spent on the wrong audienc ” 
either case, such research can enlarge the perspective of the counselor ? 
Open up new possibilities for time usage and resource allocation. 


depi 


RESEARCH AS STUDYING 
THE ENVIRONMENT 
OF THE SCHOOL 


| 
P schoo 
There are at least two major aspects to the research function of the nn 
counselor. The first has been emphasized in previous sections of this chê 


£ : ion 
ter. Counselors have a responsibility to examine their own intervent 
postures and the effect these Produce on th 


ther 
e lives of students. Put rt 
way, counselors need to periodi the use of their time and € 


3 ; r 
The counselor in this tea 

A ar school and the impact of this a i 
phere on the many ind ii: that Stennis omelo 


nos” 
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inhabit that environment (Bloom, 1964, Katz and Kahn, 1966; 
1971). They therefore desire information about this climate in order =. 
decisions about appropriate interventions to alter or modify that er 
TE ie study of school climates need not limit counselors by gana e 
their focus to only “big picture” issues. Obviously, it is equally importan 
counselors to do research on the practices they engage in each and a “i 
day. Even more so, counselors need to study the effects of these practices a 
the attitudes and behaviors of the individual students they serve. Hever 
before deciding on or hurriedly implementing intervention practices, CO A 
selors need to thoroughly examine the audiences they serve to determ 
what practices are appropriate and relevant. , . eat 
Determining the pulse and impact of a school on its hese a 
appear to be an overwhelming task. However, the means for accomplis Be 
this end are limited only by the imagination and resourcefulness of a 
counselor. Here we focus on some methods of gathering such informatio 


aa 5 3 uns ing with the 
beginning with the microcosm of an individual student and ending with 
macrocosm of the entire school. 


Shadowing 


; 55, 
ns gly aware of a general feeling of listlessne 
apathy, and indifference am r 
on much of what went on in the school. Nothing seemed to excite © 
motivate the students, and 
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schedule took her. Judy also asked Sally’s permission to take notes through- 
out the day and to check these notes with Sally at the end of the school day. 

For the remainder of the day, the counselor shadowed Sally Becker. 
This meant following the girl from class to class, staying with her as she 
chatted with other students between classes and during lunch, taking part in 
physical education and other classes, and even accompanying her to the 
bathroom. 

By the conclusion of the day, Judy Henderson was exhausted. She had 
attempted to keep a running log of the day's activities, but at times this had 
been impossible. She therefore had to bring her log up to date before sharing 
the day with Sally. Once this had been done, the two of them began with the 
mering homeroom period and worked through recorded impressions of the 

ay. 

What Judy Henderson discovered in one day of shadowing a student 
was that her school resembled a highly organized military base. Every min- 
ute of the student’s day was completely filled with predetermined experi- 
ences and inflexible scheduling. Students literally had no time during the 
school day for either socializing or friendly exchanges with their peers. The 
demands of the institution regarding rules and regulations were rigid and 
allowed no input from students. The demands of the teachers on the school 
and after-school time of students were similarly rigid and unyielding. In 
short, the school neither asked for nor sought feedback from students on 

ow the institution affected them as human beings. 

As a counselor, Judy Henderson had a number of options regarding the 
data she collected. The information could be presented to the principal with 
a series of suggestions and recommendations. She could also address a 
faculty meeting and ask them to deal with this matter. Conceivably, these 
data could also be the focus of a parent-teacher meeting or the counselor 
Might wish to discuss it with small groups of students. 

Shadowing need not be restricted to a single student, such as Sally 
Becker. A counselor could just as well follow an entire class for a day or 
Possibly some faculty members or the school principal. However, it should 

e Noted that shadowing is impressionistic and limited to the direct observa- 
tion of the shadower. Let us now consider a more refined manner of gather- 
'Ng data on a larger segment of the school as we increase our focus to an 


Entire classroom. 
Assessing Classroom Environment 
The Classroom environment in any school is the guts of that system. Not- 


withstanding a recent host of new structural, curricular, and organizational 
Innovations, the lifeblood of any school is still found in individual class- 
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rooms. As such, it behooves school counselors to familiarize themselves 
with instruments and methods that go beyond raw observation and make 
intelligible student life in classrooms (Corrigan, 1969; Fox, Luszki, and 
Schmuck 1966; Fox, et al., 1975; Jackson, 1968; Lortie, 1975). 

What occurs in classrooms is extremely important to school counselors 
because they have a vested interest in the social-emotional development of 
students. This aspect of student development should be shared and worked 
on by teachers as weii as mental health specialists. In a similar fashion, 
counselors are also concerned with the cognitive-academic development of 
students. However, what unites counselors and teachers is a mutual concern 
for the total well-being of each individual. Much of this concern occurs IN 
the crucible of daily classroom activities, relationships, and happenings. 

Assessing classrooms is not a new activity in the field of education. 
Flanders (1970) almost two decades ago devised a number of sophisticated 


tween and among teachers and stu- 
al researchers have also been active in 
(Amidon and Hough, 1967; Cornell, 
and Klein, 1957; Medley and Mitzel, 
- However, the bulk of these endeavors 
er efficiency in imparting instruction. 
mental health specialists in diagnosing 
s to record change in pupil psycholog'- 


a counselor utilizing a classroom 


2 R t 
Ba .Abri ipti i trumen 
is included so the rea pen af es 


der will have some understanding of this particular 
poses, 
ary School has seen many changes in the past we 


years. A principal with thirty years of ex 


School) retired two year: 
rived. Immediately, 


of 
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children, consulting with teachers, and conducting programs of psychologi- 
cal education. 

Some teachers in the Brook School, especially those who did not par- 
ticipate in the year-long seminar, questioned Bert Jones’ use of time. They 
felt the counselor should be available throughout the day to see unruly, 
disturbed, and underachieving students in his office. When challenged by 
these teachers, Bert Jones responded by saying that he felt his presence in 
the classroom had produced many desirable effects on children. The prob- 
lem was that Bert Jones had a difficult time documenting this statement. 

At a state convention, Bert Jones had an opportunity to discuss his 
Problem with several other elementary school counselors. One counselor 
informed him of a classroom inventory that assessed many of the classroom 
areas Bert was concerned about. This counselor had used that instrument to 
identify a number of children with specific learning and emotional prob- 
lems; the inventory could also be used for pre and posttesting of group and 
classroom affective education programs as well as for judging the impact of 
Open classrooms on children’s behavior. This particular instrument is called 


the Barclay Classroom Climate Inventory (1976) (BCCI), and it was specially 


designed to measure social interaction and expectation variables for 


elementary and junior high school children. j 
Bert Jones soon discovered that the BCCI contained 42 short scales 


Measuring (1) self-competency skills, (2) vocational awareness, (3) teacher 
expectations, (4) behavioral reinforcers, and (5) peer judgments. Further, 
these scales were to be simultaneously completed by self, group, and 
teacher. The results were tabulated by a computer that would print out a 
8t0up report for the entire class, an individual report for each child, and 
Summary tables related to the overall characteristics of the children and 
Suspected problem areas. ; 
The BCCI was initially attractive to Bert Jones because it was developed 
se in small and large groups and covered a wide range of behavior. For 
xample, the total pattern of responses for each student was analyzed in a 
Computer and then converted into a summary table that indicated suspected 
Problems for each child in such areas as self-concept, group skills, seli- 
Control skills, verbal skills, physical skills, vocational development, cogni- 
=. development, and attitude toward school. Armed with these data on an 
entire classroom, Bert Jones could then approach teachers with diagnostic 
formation calling for various intervention strategies. In addition, the BCCI 

“e's Manual contains over fifty suggestions and strategies for individual 


an “ge 
d 8roup approaches to specific problem areas. 
€ instrument therefore seemed to Bert Jones a possible answer to 


for u 
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many of his concerns. It could be utilized for an evaluation of Be 
experimental group counseling and curricular approaches in Eee en 
could also be used as a basis for identifying and/or confirming referrals ma - 
by teachers. In some cases, teachers desiring information on the en 
open and traditional classrooms on children’s behavior could utilize | i 
instrument for that end. Finally, the data derived from this instrument mier 
also be used by the counselor in consultation work with parents, teachers, 
and the school administration. 5 

The problems of Bert Jones obviously will not be “solved” by “€ 
instrument or assessment device, even though this area has shown EN 
and expansion (Epstein and McPartland, 1976; Miller, 1973; Miller, a 
and Bender, 1972). At best, such aids will give him some new data or chec 
points with which to compare older impressions and subjective information 


ae ER; N nAi ew 
In turn, by revisiting and reexamination of earlier conclusions, some n 
hypotheses could be generated and tested. 


Assessing Total School Climates 


antial attempt been made to study the a 

Hastings, and Madaus, 1971; oe 
atson, 1967). Obviously, the magnitude a 
ate of schools is staggering. Schools a 
ators, mental health specialists, ee 
S, secretaries, aides, graduate students, VO he 
es only people. What of the physical plant, ” 
manner in which it is organi and regulations, the numerous Ope" 


ool 
f the pie. What of the oR 
within each discipline? gt 
Visions, and what happe” , 


nces? 
whole. The critical question for 


‘ ta given instituti : investigd" 
tion? Consider the following. 'on are most in need of 
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Frank Hays and Mary Webb are two high school counselors in a large 
suburban school. Recently, the guidance department has come under attack 
by the local parents’ association for being “unresponsive to the students and 
parents.” Specifically, parents have charged that counselors are not availa- 
ble to students or parents when desired and that poor communication exists 
between counselors and teachers. Also, a dramatic upsurge in alcohol and 
drug-taking in the community has been placed in the guidance department's 
lap as a major responsibility. 

The counselors in this school, especially Frank Hays and Mary Webb, 
feel these charges are unwarranted. Nonetheless, they have been given 
responsibility by the principal and superintendent for answering these com- 
plaints. At first, the counselors considered making up a simple questionnaire 
that students would fill out during homeroom period. However, Frank and 
Mary felt this device would simply be seen as an in-house way of answering 
charges and therefore suspect by parents and school administration. 

What Frank and Mary wished to do in answering these charges was to 
take the primary focus of the attack off guidance. Instead, they wanted a 
study that would concentrate on the entire school and at the same time 
honor the charges against guidance. They asked the school administration 
for Permission to use a school climate instrument developed by Educational 
Testing Service and titled Questionnaire for Students, Teachers and Adminis- 
trators (1973) (QUESTA). . 

The QUESTA instrument possesses one entire section devoted to an 
evaluation of school guidance and counseling activities. Like all sections in 
the instrument, a series of questions addressed to this area is completed 
simultaneously by all students, teachers, and administrators. When scored, 
QUESTA breaks out all three groups separately and allows for comparisons 

etween attitudes held by all three groups in regard to specific topics, de- 
Partments, procedures, and so on. In this manner, a school can gain informa- 
tion about the degree to which the students, faculty, and administrators are 
Satisfied or dissatisfied with various parts of the school and with student 
evelopment. The instrument also gives data related to the nature and values 
Of the school’s subgroups, sources of tension and dissatisfaction, and so on. 

For the purposes of Frank Hays and Mary Webb, the QUESTA instru- 

Ment was ideal. It allowed for a fair evaluation of the guidance department 

Ut did not put the spotlight solely on this area alone. Rather, by focusing on 
the school’s understanding of the workings of the total environment, it en- 
arged the original intent and served a much more constructive end. Finally, 
the instrument gathered sufficient data to allow the school to improve the 
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total educational environment by suggesting actions based on data and not 
subjective impressions. 


RESEARCH AND THE 
DAILY ACTIVITIES 
OF COUNSELORS 


Little has been said to this point on the day-to-day work of the counselor and 
research. Instead, the focus has primarily been on the use of research in 
establishing worthy counseling objectives and the study of school and class- 


room life. If this seems strange, then perhaps a look at how m 


any counselors 
spend their time is in order. 


In a classic study of school counselors, Armor (1969) found that much 
of what passes for counselor work could be classified as clerical and 
semiadministrative functioning. Obviously, the fact that counselors spend 
inordinate amounts of time in noncounseling work is of interest as well as 
significant. However, it is hardly an area worthy of research unless one 
would undertake research to investigate and possibly change this situation. 

Compounding the problem of counselors frequently using large 
amounts of their time in noncounseling endeavors is the problem of apathy 
and indifference. As Kehas (1975) has noted, “Counselors themselves are 
not systematically investigating questions about their work. .. . the ques- 


tions and issues on which research is founded have been and are being 
ee by persons other than counselors or other school people” (P- 


3 The twin problems of 
een instrumental in Ing any major effı elors tO 
do research. Those studi 8 any major effort among school couns! 

have by and lar n ; Herr 
; Y university personnel (Cramer, t 
Morris, and Frantz, 1970; Volsky, et al., 1965; Whiteley, 1968). Rarely have 
wee 2 eon 

school counseling, © and body of existing knowleds 


forced counselors to stat 
their programs. In additi 


some criteria be advanced (usually in be 
growth over specific time periods 
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The spur of accountability could force a new surge of interest in coun- 
selor research. However, it could also simply result in a greater amount of 
traditional data gathering. For example, many counselors and/or school 
guidance departments do yearly studies on drop-out rates, number of high 
school graduates continuing education or going on to two and four-year 
colleges, schoolwide achievement test averages by grade equivalents or 
Percentile rankings, and so on. These studies are then analyzed and distrib- 
uted with a tacit understanding that guidance and counseling have some- 
how influenced the factors under study. 

Unfortunately, yearly studies of achievement test results, drop-out 
rates, and the like do not accurately reflect the work of the counselor. 
Counselors do, of course, have an investment in these areas and certainly do 
influence student behavior but these types of studies overlap considerably 
with teacher behavior, In other words, teachers have as great or greater 
influence on many of these behaviors as do counselors. It is therefore impos- 
sible to sort out the impact of a given counselor, vis-a-vis a student's 
achievement test results, from that of the many teachers working with this 
student each day. 

Accountability models in some c 
whereby counselors can study their work with students. For inst 

avioral contracts have become increasingly popular among counselors in 
work with both individuals and groups. These behavioral contracts lend 
themselves easily to research and study because they require the clear 
statement of predetermined goals in behavioral terms. For example, a be- 
haviora contract of a student experiencing academic problems could read, 

l will meet with my counselor each Monday and Friday morning at 9:00 
a.m. to discuss my work in English and Science. We will go over my tests 
and assignments during the week and once a month we will also meet with 
My teachers. | would like to raise both of these grades from a low C to a B by 
the end of the first semester in January.” 

The example just cited is a rather simple way of looking at change in 
Student behavior. The use of behavioral contracts does place a clear respon- 
sibility on the student for specific outcomes and allows the counselor to 
validate data by observable phenomena. It has a weakness if the counselor is 
“ngaged in long-term work with students or if the intended outcomes are 
difficult to state in behavioral terms. For example, a counselor engaged in 
sep work who wished to develop decision-making skills in students may 

this is a developmental process extending over many years. As a conse- 
hr the fruits of the counselor’s work may not show up in a predeter- 

€d period of time. In fact, the results of this work may show up only after 


ases have suggested other means 
ance, be- 
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the student leaves school and is forced to deal with various career and work 
wo conducted by school counselors can take many ene te 
chapter has illustrated only the tip of the iceberg. We have ee on 
apathy, indifference, haphazard planning, lack of tenacity, ina ae her 
ics, and poor use of time are only a few of the obstacles along | he 
However, all of these can be overcome by the counselor desirous of ei 

ing both practice and setting to ultimately better the life of students. 


CONCLUSION 


5 x R iberate 
The emphasis on school environments in this chapter has been a int gli 
attempt on the part of the authors to depart from traditional re ve 
phasis on counseling, especially one-to-one counseling. Our desir 


been to demonstrate that significant changes in schooling can occur anly Sy 
research on the total environment of a student, and not simply that crea 
in a counselor's office. 

For too lon 


r stu- 
g the promise of guidance and counseling has eluded st 
dents. Part of thi 


s promise can be attained by the school counselor pung 
a more active role as a researcher of the conditions underlying the orl 
phere of schools. The counselor too is part of this environment and how 

counselor chooses questions and seeks data to clarify these hypothesis may, 
in and of itself, change the conditions in that atmosphere. 
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CHAPTER 9 
The Counselor as 
Researcher in the 
College Community 


Ursula Delworth 


Counseling in the college and university community can be an exciting 
experience and there are several significant functions for counselors on 
campus. Helping individual students with personal, educational, and career 
| implementing programs to reach large numbers 


Problems; developing and 
onals and other mem- 


of students; and training/consulting with paraprofessi 
bers of the college community are some of the main services being offered. 
Counselors are beginning to view themselves as researchers as well as 
Service providers on campus. They are realizing the importance of evaluat- 
ing their work as well as learning to see the value in knowing more about 
their students as a basis for planning services and programs. Colleges often 
Provide unique resources for this study, such as expert consultation, re- 
Search facilities, and the opportunity for association with faculty and stu- 
ents, By using these resources, counselors can develop skills and under- 
Standings that will allow them to know more about what they are and could 
€ doing. The research function can be rewarding and enjoyable for coun- 
Selors, and it has great potential for enhancing the lives of students. 
Studies done in the past few years can tell us a great deal about college 
imdents and their interaction with the counseling process. Perhaps more 
Portantly, they also point to many unanswered questions, and to prob- 


ems with many of the research methods utilized. 


ARSEARCH ON COUNSELING 
COLLEGE STUDENTS 


T 5 
us reviews in recent volumes of the Annual Review of Psychology 
ayton, Sandeen, and Baker, 1971; Pepinsky and Meara, 1973; Whiteley et 
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al., 1975) provide fairly comprehensive looks at the recent research in col- 


lege counseling and regarding college students. Only a fraction of the issues 
can be dealt with here. 


Counseling Services 


Much of the current discussion and research in the literature deals with three 
areas: counselor roles and services, counselor training, and counselor neg 
ventions. Some pertinent topics in each area are presented in more detail. 


COUNSELOR ROLES AND SERVICES. College counseling centers, in col- 
leges regardless of size, indicate that they offered three main services: (a) 
counseling for personal problems, 96 percent; (b) counseling for study prob- 
lems, 92 percent; and (3) counseling for choice of major field, 91 percent 
(Anderson, 1970). A number of surveys done over a ten year period (War- 
man, 1960, 1961; Wilcove and Sharp, 1971; Resnick and Gelso, 1971) 
indicate that college counselors see their most appropriate role as that of 
counseling students with personal problems. However, students, faculty, 
and other student services staff indicated priority for academic and educa- 


tional counseling, although they included personal counseling as an aP“ 
propriate function. 


COUNSELOR TRAINING. The core facilitative or counselor-offered condi- 
tions proposed by Carkhuff (1969) and others have formed the basis fO" 
much of the increasingly skill-oriented training offered to counseling stu 


dents. These conditions include empathy, self-di f jan: 
s , self-d frontatio 
Studies by Carkhuff (1969) F a 


b and Truax and Mitch ng others, 
offer considerable evidence supporting the iden: ber aaan Aae con- 
ditions and client change. Although more recent research has raised que 
tions concerning the dimensions and, in particular, the validity of rating 
counselors on the conditions at one period (Gutman 1973), these condi- 
tions have become the basis for a number of training approaches (Carkhull 


1969; Kagan, etal., 1967; Ivey, 1971: Dani . Bramme! 
1973; Egan, 1975) i Danish and Hauer, 1973; Bra 
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INTERVENTIONS. There has been a significant increase in both use of and 
research on behavioral approaches in college counseling. Such techniques 
as setting observable behavior goals with clients and using desensitization 
procedures have been effective for a variety of client problems (Bandura, 
1969; Krumboltz and Thoresen, 1969; Suinn, Edie, and Spinelli, 1970; 
Mehrabian, 1970). 

Among other key development 
beyond remedial, direct services to in 
preventive and developmental services to both groups and institutions has 
been developed by Morrill, Oetting, and Hurst (1974). This model provides 
a basis for many of the newer outreach programs on campus in which 80 
percent of counseling centers are reported to be involved (Morrill and Oet- 
ting, 1970). However, limited research on the effectiveness of such interven- 
tions has appeared in the literature. 

As with research in other areas, research on college counseling suffers 
from a variety of methodological difficulties. Small numbers in treatment or 
training groups, lack of controls, and lack of randomization are among the 
largest problems in the research that has been done. The research also 
Suffers from lack of replication of studies, where the same intervention or 
training approach would be used with different groups of clients, subjects, or 
trainees, and with different counselors or trainers. In addition, Carkhuff 
(1966) states that “we must move further into the environment of the client if 
we are to account fully for the effects of counseling” (P- 471). 


s has been an expansion of services 
dividuals. A model that incorporates 


College Students 


Researchers in higher education are increasingly studying the college stu- 
dent and the college environment as a basis for determining appropriate 
interventions on campus. The work of Astin is probably the most ambitious 
undertaking in this area. This work is a longitudinal study of (a) administra- 
tive characteristics (b) environmental stimulus factors such as peer envi- 
fonment and classroom environment, and (c) the college image (Astin, 

6B); Among some of the most important findings in this work thus far for 


Coll 5 ABER 
ge counselors are the following: 


® Students’ career choices change to conform more and more to ie 
dominant model choice of their peers 45 they progress through the 


undergraduate years (Astin and Panos, 1969). 
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© Individual student achievement is neither improved nor impaired 
by the intellectual level of classmates, the level of academic com- 
petitiveness, or the financial resources of the institution (Astin and 
Panos, 1969). 


Marriage and living off campus contribute substantially to students’ 
chances of dropping out of college (Astin, 1975). 


Astin and others (Newcomb and Feldman, 1969; Chickering, 1969) 
have made recommendations to colleges based on their data. Unfortunately, 
as yet few studies have been done on students and their interactions with the 
campus environment at specific colleges. Such studies are necessary in 


order to design appropriate interventions and services for any specific col- 
lege population. 


DIRECTIONS FOR 
COLLEGE COUNSELING 


College counseling in the 1970s is apparently still highly invested in direct 
services to individual students who have concerns of a personal, educa- 
tional, and vocational nature. However, many centers are currently involved 
in some type of outreach programming, which often focuses on preventive 
and developmental services and the use of students as paraprofessional 
counselors. There is an increased emphasis on large-scale longitudinal re- 
search that describes college students and their campus, and predicts out- 
comes of the interaction between student 

Counselors are increasingly involved 
their work and training and in trying to u 


and college environment. í 
in looking at the effectiveness © 


; : nderstand the needs of the often 
diverse groups of students who enroll in colleges today. Problems, however, 


remain for counselors as they attempt to understand their students and the 


impact of counseling in the lives of these students. Among the predominant 
problems are the following: 


Current research on counseling interventions generally has many 


methodological problems that make it difficult for counselors to trust 
and use what is being reported. 


There has been little research done on the newer outreach efforts under“ 


taken by counseling centers, and often limited knowlege of how to 
this work—and gain support for doing it. 
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There has been limited attention paid to the process and outcome of 
setting relevant and realistic goals for counseling services. 


There has been limited attention to study of students and their interac- 
tions with the college environment on individual campuses. 


The student development approach articulated by Layton, Sandeen, 
and Baker (1971) speaks to these issues. They view student development as 
the product of person-environment interaction, or the “result of the interac- 
tion of student characteristics, including expectations of college, and the 
Opportunities, demands, restrictions and sanctions, concerns and indiffer- 
ences of the college environment and its subcultures” (pp. 533-534). Layton 
et al. contend that in order to develop programs and methods, counselors 
need to adopt models of human behavior that take into account not only the 
qualities of individual students, but of the setting in which students live. 
Unless counselors can look first at what their college is all about, and what is 
happening to students in their specific college environment, they run the risk 
that their interventions—no matter how successful—will have peripheral 
impact on the lives of students. This idea—inherent in an ecosystem 
approach—serves as an organizing framework within which questions of 
Appropriate goals and valid, effective services can be asked and answered, 
Because of the great importance of the ecosystem approach and its promise 
as a framework for counselors and other student personnel workers, most of 


the remainder of the chapter focuses on it. 


ECOSYSTEMS 


ch and design process utilizing an ecologi- 
h an approach is the interaction that occurs 
ment, or how an environment affects 
d their personal growth. The model was 
Commission for Higher Education 
t thinking in social ecology and 


The ecosystem model is a resear 
Cal approach. The essence of suc 
€tWeen persons and their enviro! 
People, their work, their leisure, an 
©veloped at the Western Interstate 
(1973) and based on much of the curren 


Student d 

evelopment. 

Traditionally, colleges have responded to students who were not ad- 

Justing to their campus environments by easing them out or referring them to 
p d them in making an adjustment. 


a service ( ing) that would ai 
often counseling) tha z f 

arely has attention been paid to institutional adjustments in terms of pro- 
Brams, policies, or physical spaces. Even when new services have been 
n a this is rarely done on the basis of systema- 


Offered or existing ones expanded, 
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tic data concerning person-environment fit. Ecosystem theory does not deny 
that some students should leave college or that some students will need 
individual assistance while in college. What it does assert is inclusion of an 
alternative option—the design of environments that ameliorate and prevent 
unnecessary problems and enhance student retention and growth. In other 
words, the approach introduces a “quality of life‘ dimension to viewing the 
campus. Such design is necessarily based on research regarding students 
and the college, and the transaction between them, or the person 
ir nt fit. 

a ee model's design philosophy, as articulated in the WICHE 
report The Ecosystem Model: Designing Campus Environments (1973) 15 
rooted in eight basic assumptions about persons and environment: 


1. The campus environment consists of all the stimuli that impinge 
on the students’ senses and includes physical, chemical, 
biological, and social stimuli (policies, relationships, physical 
spaces, programs). 


2. A transactional relationship exists between college students and 
their campus environment; that is, the students shape the 
environment and are shaped by it. 


3. For purposes of environmental design, the shaping properties of 
the campus environment are emphasized; however, the students 
are still viewed as active, choice-making agents who may resist, 
transform, or nullify environmental influences. 


4. Every student possesses capacity for a wide spectrum of possible 
behaviors. A given campus environment may facilitiate or inhibit 
any one or more of these behaviors. The campus should be 
intentionally designed to offer opportunities, incentives, and 
reinforcements for growth and development. 


5. Students will attempt to cope with any educational environment 
in which they are placed. If the environment is not compatible 
with the students, the students may react negatively or fail to 
develop desirable qualities. 


6. Because of the wide range of individual differences among, 2 
students, fitting the campus environment to the students require 
the creation of a variety of campus subenvironments. 
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a Every campus has a design, even if the administration, faculty, 
and students have not planned it or are not consciously aware of 
it. A design technology for campus environments, therefore, is 
useful both for the analysis of existing campus environments and 
the design of new ones. 


8. Successful campus design is dependent on participation of all 
campus members including students, faculty, staff, 
administration, and trustees or regents. 


The model’s process is utilized to identify shaping properties in the 
campus environment in order to eliminate dysfunctional features and to 
incorporate features that facilitate student educational and personal growth. 
For example, a physical space might be altered, or a policy changed. In 
other instances, a service might be offered to help a specific group of stu- 
dents such as mature women cope with stress in the environment and better 
utilize educational opportunities. 

The model can be applied at a macro-level to study and design envi- 
ronments for the entire campus community. It can be applied at a micro- 
level to study and design subenvironments for groups within the campus 
Community such as residence hall students, students who are members of 
ethnic minority groups, Or students majoring in biological science. And it 
Can be applied to route individual students to a physical environment, ser- 
Vice, or program that has been demonstrated to be meeting student needs. 

his would be considered an individual design project, and is usually the 


one most familiar to counselors. pe 
The ecosystems approach consistently takes the values and goals of the 


institution into consideration, translating these into environments (buildings, 
Curricula, policies, services) that contain mechanisms to reach the stated 
80als. Student perception and behavior are assessed to provide data on how 
well the student-environment fit is working, and how well the changes 


'Mprove this fit. 
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OLOGICAL APPROACH 


ave begun to systematically apply an 
d many others are utilizing some of 
approach. In a time of limited 
among the public and in 


ace counselors and agencies h 
gical framework to their work, and 
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the legislatures, and increased accountability regarding counseling services, 
it makes sense for counselors to study this approach and devise ways to use 
it to enhance their impact on students and the college. 

Counseling services that have assessed the needs of students and the 
parent institution, built their system of services based on these needs, com- 
municated the availability of services to students, and evaluated and re- 
ported these services are currently reported to be experiencing much better 
success than those agencies not involved in such activities (Kelly, 1975): 
Such an approach is basically ecological, and answers three questions vital 
for every counseling endeavor: (1) What are the goals and objectives of 
counseling services on this campus? (2) What methods are counseling ser- 
vices using to meet these goals and objectives? and (3) How well are these 
goals and objectives being met? 


Setting Goals and Objectives 


A system developed at Colorado State University (Hurst, Moore, David- 
shofer, and Delworth, 1976) serves as one example of using an ecological 
approach in setting goals for a counseling agency. The staff designed a 
ten-step sequence to set and meet agency goals, yet allow for staff member 
individuality. The first two steps relate specifically to setting goals and objec 
tives. 

Step One: Identify and/or define institutional goals. This step is de- 
signed to emphasize the interdependence between the counseling center 
and the larger institution. Because college goals will differ, and some may 
not be clearly stated, the Colorado State group adopted the American Coun- 
cil on Education (later reprinted as part of Creager, 1968) conceptualization 
of the higher education process (Figure 9-1). This conceptualization is 8€- 
eral enough to apply to all institutions of higher education and yet specific 
enough to complement most college goal statements. The conceptualization 
is helpful in deriving agency goals and objectives that are relevant to institu- 
tional goals. 

Step Two: Derive agency objectives from institutional goal statements. 
Morrill and Hurst (1971) proposed a role for a counseling agency that is one 
example of how an agency may derive its objectives from the broader 
statement of institutional goals. Their statements are as follows: 


1. To provide students with those skills, attitudes, and resources prerequisite to 
maximum utilization of and success in the learning environment. 
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(2) College environment variables 


Curricular offerings 
Faculty 

Living situation 
Administration 
Academic advising 
Physical facilities 
Library 

Research 

‚Activities 

Peer interaction 


(3) Interaction 
variables 


(1) Student input variables (4) Output variables 
Background Achievement 
Abilities Graduation 
Academic skills Citizenship 
Achievements Academic skills 
Social skills Values 
Attitudes Interests 
Aspirations Attitudes 
Knowledge Aspirations 
Interest Vocation 

a 
FIGURE 9.1. Primary Variables in Higher Education 


2 äi = 
te To contribute to, modify, and 
© established principles of learning 


i To acquire information about studen 
ion j : : 
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es (1) and (2) above. 


die first statement is an objective 
in the ACE conceptualization. Th 


8roup of variables, and the last statemen 
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es and includes both of t 


enhance the university en 
and human development. 


e second w 
t relates to t 


vironment according 


ts, their environment, and their interac- 


levant programming to achieve objec- 
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as derived from the sec- 
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Methods for Meeting Goals and Objectives 


Once overall goals and objectives have been set and priorities determined, 
specific services are derived, and the entire system monitored. An important 
provision of such processes will be negotiation between staff members so 
that high-priority services, based on assessment of student needs, will be 
offered, while at the same time staff members will have opportunity to 
exercise their own skills and interests. 


Evaluating How Well Goals and Objectives Are Being Met 


Evaluation, or evaluative research, is aimed at collecting data on the effec- 
tiveness of programs or services that will help in making decisions. 
Evaluators are not concerned with proving or disproving a specific theory- 
Instead, they are concerned with whether a specific program should be 
continued, Evaluation data on effectiveness serves as the basis on which 
additional factors (such as program costs and campus support) are looked at 
in the decision-making process. Without data, counselors risk continuing 
programs just because they are fun to do and don’t cost much! 

Program monitoring is a vital part of this process and should be distin- 
guished from evaluation (Oetting, 1976). Monitoring provides data on 
number of students involved in services, how staff hours are spent, and so 
on. This is helpful information for both agency staff and higher adminis- 
trators, but does not tell the agency if a program or service is effective. 


COUNSELOR COMPETENCIES IN 
AN ECOLOGICAL APPROACH 


As counselors begin to appreciate the viability of an ecological approach, 
they come to see that the entire system is built on research, on knowing 
enough about the campus community and its inhabitants—students, faculty, 
and others—to design environments that will prevent problems and facilitate 
growth and well-being. Research alone, however, will not automatically 
lead to desired changes. Counselors also find that they must be able to work 
with professional colleagues and students in order to gather and disseminate 
such research. They must be able to demonstrate the effectiveness of new 
designs, be they programs, policies, or changes in physical space. Little of 
this necessary knowlege is easily obtainable via the established path ol 
“pure research” or scientific inquiry. Certainly, knowledge of statistics an 

experimental design is needed (at least by someone in the agency), but 
much more is required. What is needed most of all are new technique’, 
better applications of little-used methods, consultation skills, and the WU" 
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lingness to try approaches that have not yet been proven or recorded in the 
literature. 

Obviously, the specific expertise of counselors in delivery of services 
such as individual counseling and training is still vital. What is added in the 
ecological approach is that there are new tasks to learn, and that research, in 
one form or another, is a basic part of these tasks. Further, since doctoral- 
level counselors and psychologists are usually as inexperienced in some of 
these approaches as masters-level counselors, graduate students, and un- 
dergraduate students, no one group of counseling personnel has all the 
answers. The ecosystems approach requires new learning for all, and en- 
Courages the unique contributions of each type and level of professional 
expertise. 

A process for using an ecosystem approach at the micro-level (agency 
or department) has been developed at the Western Interstate Commission tor 
Higher Education (Aulepp and Delworth, 1976). The model comprises five 
stages, 

Stage | involves the establishment of a planning team, based on the 
assumption that successful campus design is dependent on participation of a 
Variety of campus members. Students, faculty and administrators and staff 
from the target environment (€.8-, residence hall system or counseling 
center) are always included. . . 

Stage Il concentrates on determining what aspects of the environment 
the planning team wants measured in terms of student perceptions. 

Stage III is involved in the development of a technique or techniques to 
asure perceptions and also to assess why students hold their perceptions. 
hatis, planners want to know what has happened to students to cause their 
Perceptions. Without such information, there is insufficient data for redesign 
Purposes. For example, we may discover that 90 percent of the students 
i negative perceptions of the counseling center, but we do not know 
t aether these perceptions are based on attitude or behavior of counselors, 
Physical setting, insufficient information, Or a variety of other factors. 
Ntil the planning group has this information, it is ın danger of making the 


Wrong redesign in the center. 

Stage IV involves administering the asses 
ng an initial data analysis. . i . 
m Stage V includes processes for the subsequent redesign of the environ- 
- ent as well as suggested procedures for evaluating the effects of the rede- 

EN in terms of reaching agency and institutional goals. 

ia ak here are a number of competencies that counsel ors must gain in order 
ia, ectively apply an ecosystem model. As a minimum, they must be able 


me, 


sment techniques and con- 
ducti 
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e Understand the organization of the campus community and be able 
to work with a variety of professional colleagues (administrators, 
faculty, other student services staff). 


Assess the needs, perceptions, and behavior of students, across var- 
ious groups, and in a variety of environments and thus determine 
the person-environment fit. 


e Work with students as colleagues in planning and implementing 
research and service designs. 


e Do evaluative research on services, programs, and other activities. 


Interpret and communicate research data and recommendations to 
members of the campus community. 


Develop and implement programs and services in a systematic 
manner. 


Each of these skills is discussed in more detail, with examples from 
various college campuses. 


Working in the Campus Community 


Counselors have to know how the institution functions to get its work ac- 
complished, both formally and informally. Written information (such as 
organizational charts) is helpful, but rarely gives much insight into the in- 
formal process. Counselors thus must develop a “network” of knowledge- 
able faculty, students, administrators, and staff who can give them clues 
regarding how the system “really” operates; that is, who on campus are ie 
persons of influence. u 
It is vital that counselors tune into the “climate” or “political realities 

on campus. Without such insight, they risk developing programs and ser 
vices that are based on student need but are unacceptable to campus tradi- 
tions or values. Once the realities are known, counselors can decide to m 
set aside a controversial or unacceptable program, or (2) devise methods to 
gain support for the program before it is offered. : 

There are a number of ways to gather needed information on Hel 
mate.” One campus group asked a sample of faculty, students, admin's 
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trators, and staff to rank current and potential services in order of impor- 
tance. They followed up to determine if low-ranked services were seen as 
merely low priority or were unacceptable to some group or groups. 

When counselors desire to develop a program that is important to 
students, but negative political realities stand in the way, they would do well 
to involve influential campus members in the planning and implementation 
of the program. At one campus, need was demonstrated for increased edu- 
cation and communication in the area of sexuality. In this church-related, 
private college, however, there were many constraints against moving into 
this area. Counselors invited key administrators and campus ministers to 
become part of a planning group. The result was a program that met student 
needs in a manner the college could support. 

Counselors need professional colleagues in the campus community on 
an ongoing basis for information about the campus, to help assess 
Person-environment fit, to be their “reality testers,” and for support. Many 
times also, such colleagues become involved in the offering and evaluation 
of Counseling services. On one campus a core group of leaders for a marital 
enrichment workshop is composed of campus ministers. A number of 
faculty are involved in the counseling service's ethnic relations effort on the 


Same campus. 


Determining Person-Environment Fit 


Counselors have to be able to determine the congruence between what 
Students need and want in the college environment and what students are 
Betting—the “fit” between student and environment. 

Such an assessment might look at the entire campus (macro-level) or a 
Subenvironment (micro-level) such as the counseling service or the resi- 
dence hall system. The assessment might also examine a specific group of 
Students, such as mature women returning to college, freshmen, or graduate 
Students, Ideally, counselors would probably want to look at the fit between 
Students and counseling services first. The increased skills and credibility 
8ained through this endeavor should make it easier to join with other per- 
“ons assessing other environments on Campus. 

Certainly, in any effort, counselors must be sure to involve at least 


Several appropriate campus members in planning the study. Such input 
5!ves a wider perspective, and often results in more credibility on campus. 
he approaches to be used in this assess- 


ki There is probably no end to t i Us 
ent. The following are among some currently being utilized on campuses 


a 
cross the country. 


and groups in 
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Listing current or possible services of a counseling agency and asking 
students to rate or rank these in (a) importance, (b) availability, and (c) 
success in meeting student needs. 


Listing needs or interests and having these rated or ranked in the same 
manner as above. In this instance, it is helpful to ask students to indicate 
how or where the need or interest is being met. 


Interviews with students (either fairly large groups or in-depth inter- 
views of a few students). 


Questionnaires that gather student perceptions of various campus envI- 
ronments, or different aspects of one environment. 


“Environmental referent” forms (Aulepp and Delworth, 1976) that fol- 
low perceptual questionnaires and ask students to give more informa- 
tion on why they hold their perceptions and what they think should be 
done regarding any given situation. 


Goal statement inventories, which ask students to rate college Or 
agency goals in terms of “is” and “should be.” 


Observations of student behavior in various environments at various 
periods. 


Demographic data on students to determine factors in dropping out 
versus staying in school or other information (Astin, 1975). 


Assessment of personality and/or developmental stage that can be com- 


pared with demographic data to determine optimum environments for 
different students. 


Interviews with key “sensors” (those with maximum student contact ON 
campus). Such persons will include faculty, but other groups can also 
be important. On one campus, women who served food in the student 
union cafeteria were found to have a great deal of valuable information 
regarding student concerns and needs. 


Interviews or questionnaires given to selected groups of students at 
stated intervals. 


Telephone surveys. One large university has set up a telephone survey 
service with trained students as interviewers. Any agency or organiza- 


tion can request help in designing a survey that is then implemented by 
the service. 


There are many more techniques and methods in current use. Probably 
the most productive assessments utilize more than one method to gather 


THE COUNSELOR AS RESEARCHER 281 


information, especially if one method chosen is a standardized instrument. 
Such instruments can be very useful, but they are limited in that they may 
not ask questions about what campus members sense are the crucial issues 
on a given campus. They often lack “face validity” with students by using 
unfamiliar terms or asking about environments that do not exist on a specific 
campus. 

Additionally, more creative methods can be devised. One suggestion 
(as yet untried) is to equip students with inexpensive cameras and ask them 
to record “positives” and “negatives” in their experience during a week’s 
time. Interviews could then be held to specify the picture’s meaning; for 
example, an empty dorm room might signify a student’s lack of friends and 
worthwhile activities. 

The same methods can be used to assess fit between the environment 
and persons other than students (e.g., faculty or staff). Some studies compare 


Student perceptions with those of faculty members (Huebner, 1975). 


Working with Students as Colleagues 


Undergraduate students have an important (though often overlooked) part to 


Play in all aspects of an ecological approach. Certainly they are the primary 
targets of study and design, but they are also valued colleagues in planning 
and implementing this work. Students often have a better idea of what 
Approaches (both for research and delivery of services) can work. They 
Usually have more credibility in approaching peers for assessment or in 
Program implementation and evaluation. Perhaps most of all, they ask im- 


Portant questions and they help to keep professionals “on the track” of some 
Of the crucial but difficult issues that counselors and other staff find hard to 


ace, 

in student paraprofessionals on campus, and 
agencies to deliver services to the student 
a 


currently involved as: 


Ma There has been a rapid rise 

bo nY of these have been used by 
Pulation. In addition, students are 

Members of teams planning person-environment assessment and de- 

Sign 

Implementers of research projects 

Pi 

rogram evaluators 
Interpreters of research data 


“Change agents” to implement designs based on studies of 


Person-environment fit 
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Developers of new programs and services, either alone or in conjunc- 
tion with a counseling or other campus agency; crisis lines and birth 
control clinics are probably the outstanding examples in this area 


Students themselves can gain much by their involvement in such ac- 
tivities. They acquire new skills and added self-confidence. Their participa- 
tion can increase their sense of belonging and contributing to the campus 
community. In addition, many are able to “test out” possible vocational 
plans and acquire letters of recommendation for graduate school or future 
employment. A number receive money or academic credit for their work. 

Counselors who take the time to involve students in their work usually 
gain added insight into student pressures, concerns, and values. They gain 
new and innovative ideas on how to approach problems, and also benetit 
from the help of dedicated, skilled students to implement ideas and plans. In 
return, counselors should be sure to train, supervise, and consult with stu- 
dents, especially when students are working on tasks that are new to them. 
In many cases, students and counselors are actually learning a new ap- 
proach together. 

In the new “consumer society” students expect to monitor and im- 
prove the quality of their educational experience. Counselors can involve 
them in doing this—to the benefit of the students, the counselors, and the 
campus community as a whole. 


Evaluative Research 


Evaluative research is done on programs and services in order to make 
decisions regarding whether to continue such programs or how programs 
may be modified to become more effective. It is not a conservative process 
in that decisions must be made about programs based on the best data 
available rather than on absolute “proof” that a program works. If there are 
alternative explanations of data, the counselor-evaluator and the decision- 
makers must weigh these carefully, and decide what alternatives are the 
most likely. If the best estimate is that a program works, then it might be 
continued (other factors such as cost being taken into consideration) 4" 
further evaluation done. 

This approach clearly differs from scientific inquiry, which aims at 
advancing scientific knowledge. An example might clarify the difference. 
marital enrichment workshop is being run for student couples. The evalua 
tion plan calls for measures of attitude toward self and partner, and behavior 
change in terms of self-report and report by the partner on specific objec- 
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tives regarding communication, intimacy, and fighting styles. There are 
enough participants for the group, but not enough for a control group. It is 
Possible to get pre and post scores, but the design is not very good in terms 
of scientific inquiry. Any changes could be due to the program itself, but 
Could also be a result of such factors as a feeling on the part of the partici- 
Pants that they have been designated as a special group, statistical regres- 
Sion, maturation, expectancy, or even the charisma of the group leader. 
Although some of these possibilities are less ikely, others have led to sig- 
nificant research results. Therefore, from the point of view of scientific in- 
Quiry (and the view of most journal editors), the study has minimal value. 
However, if positive results are obtained, the program may be continued, 
building in a control group (or using the participants as their own control), 
Perhaps running groups with different leaders, and perhaps using a 
“placeboid’’ group that would undergo some form of “treatment” but not 
receive the program itself. If results are negative, evaluators and decision- 


Makers will want to consider, among other things, whether their evaluation 
ange. If the program is considered very impor- 


Plan was really measuring ch A 
tant, then it might be rerun with more careful evaluation. o 
_. Evaluative research, although often lacking some of the rigor of scien- 
tific inquiry, is equally important because it helps counselors and others 
Make “real life” decisions. It allows counselors to carry on their work ina 
More responsible, ethical, and productive manner, and it aids counseling 
Agencies jn becoming more accountable to the college as a whole. 
However, counselors should not assume that evaluation plans are al- 
Poor research designs. Evaluators who think about possible crucial 
atives to explain data ahead of time may well be able to modify their 
Plans so that these alternatives can be more safely rejected when results are 


ety is important, however, to realize that in the “real world” of len 
'S typically impossible to control for all potential sources of te! at least 
any one study. Therefore, evaluation of programs and services becomes 
Ongoing process, or “way of life” in which successive studies continue to 
p, Onstrate program effectiveness through elimination en 
i.” Studies with severe limitations are often more USS han 


Tat least as a start! 


Ways 
altern 


In 
erpretation of Research 


l . 

N the Past, counselors have often thought that doing good research 

Scientific research and evaluative research—was sufficient. ate they are 
INB to realize is that administrators and other members of the campus 
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community many times do not make a clear connection between data and 
meeting goals and objectives in their own areas. What is needed are ways of 
interpreting and communicating research findings in a manner so that these 
decision-makers can hear and act on the findings. 

One university planning group chose to issue a series of brief reports on 
their study of person-environment fit in residence halls, each dealing with a 
different area of study. They combined this with meetings with key adminis- 
trators and staff members of concerned agencies. They also had a general 
overview of the study and its results published in the university newspaper. 

A community college planning group presented their questionnaire to 
department chairpersons and faculty, and asked which items or areas of the 
assessment were of most importance to that department. A tailor-made re- 


port of results (both perceptions and reasons for these) was then developed 
for each department. 


Program Development 


All of the previously discussed competencies are important in the develop- 
ment and implementation of effective programs and services. In addition, 4 
definitive process for program development is needed, This process should 
indicate specific methods, techniques, and a sequence for utilizing the 
competencies and applying any other skills that are important (e.g., review 
of relevant research on programs similar to the one being planned; group 
leadership). 

Most counselors develop a sense of program planning through experi- 
ence. The danger here is that they may spend a good deal of time gaining 
such experience at the expense of good programming. It would help coun- 
selors to (1) work with experienced colleagues in developing a program 
planning process, and/or (2) take an already developed process and adapt it 
to their specific situation. One example of such a process was developed by 
Moore and Delworth (1976) 


KEY AREAS FOR STUDY 


In doing both scientific and evaluative research, counselors will want to 
address themselves more systematically to some key issues in college coun- 
seling. In addition to issues on individual campuses that need the attention 
of counselors in terms of research, there are a number of issues or areas of 


study that appear relevant to the college counseling field as a whole. Among 
these general issues are the following: 
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The Effectiveness of Paraprofessional Counselors 


Students and other paraprofessionals are being utilized more and more as 
deliverers of counseling services (Layton, Sandeen, and Baker, 1971). Al- 
though such helpers have been effective in a wide variety of service areas, 
Counselors cannot assume that paraprofessionals will be as effective as pro- 
fessionals in any given program on a specific campus. Careful studies of 
Professional versus paraprofessional effectiveness are currently few in 
Number, and are generally case studies of one program. Well-designed, 
Multivariate, longitudinal studies are much needed. Studies of comparative 
eifectiveness of various training approaches with paraprofessionals (as with 
Professional counselors) are also needed. 


Career Counseling Approaches with Various Groups of Students 


There has been a proliferation in recent years of approaches and methods for 
Career counseling with college students. Layton, Sandeen, and Baker (1971) 


assert that vocational development theorists agree in conceptualizing choice 


Making as "a dynamic and complex process with the growth of the indi- 
as that by Faunce (1968) 


pausal of central concern” (p. 543). Research such (1 
aS increased our knowledge of the relation of personal characteristics to 
Career choice. Little attention has been paid to what career choice ap- 
Proaches are most effective with specific groups of students. It may be that 
Students vary considerably in terms of their ability to utilize various ap- 
tes. Methods that rely heavily on students’ ability to seek out informa- 
Sua and resources on their own may be most effective for some. Other 
Guten may need and value the support and stain z A n graei 
Nor ne their career exploration. Counselors should study learning styles 

hatch these with career counseling approaches in order to maximize 


Ccass f 
Sss for each student. 


Effectiveness of Training and/or Consultation in the Campus 


Munity 


deal of effort in training and consult- 
residence hall staff, departmental 
ities consists of a report by the 
he help given, and sometimes a 
nselors need to develop 
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clear objectives for such interventions (even for brief interventions) and 
systematically evaluate how well those objectives were met. Objectives 
(and subsequent evaluation) would be concerned with such issues as the 
following: 


Skills learned by trainees or consultees. 


Specific uses made of the training or consultation by trainees or consul- 
tees. 


Effectiveness of these uses. 
Further service requested by trainees or consultees. 


Ability of trainees or consultees to generalize skills to new situations. 


Effectiveness of Audio, Visual, and Written Materials 


As these methods replace live counseling interventions, evaluation must be 
done to determine if such materials are as effective, or even more so, than 
the same service performed by a counselor. Because such materials often 
are part of a program sequence, it is important to know if they add to or 
detract from the overall effectiveness of the program. For example, do video 
or audio career guidance materials facilitate the student's information ac- 
quisition and decision-making to the same (or greater) extent than meeting 
with a counselor? Do written “homework” materials facilitate skill practice 
in marital groups between sessions? 


Programs and Services to Enhance Development 


Sprinthall and Erickson (1974), Ivey and Alschuler (1973), and others have 
stated that counselors must become psychological educators, using their 
skills and knowledge to Promote personal growth through the curriculum. A 
number of models of cognitive and ego development (Kohlberg, 196% 
Loevinger and Wessler, 1970) have relevance for college students. It is NOW 
up to counselors to study these models, and develop the mechanisms an 

Programs that will enhance development in students. One promising start IN 
this field is Erickson’s (1975) report on a program of deliberate psychological 
education to enhance growth for women college students. Several colleg® 
are experimenting with enhancing values and personal development 
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through a variety of curriculum offerings, using counselors as planners and 
Consultants. 


CONCLUSION 


College students continue to be the most highly studied group in the coun- 
seling field. Yet much of this research is limited to a particular small popula- 
tion and institution, and does not speak to issues of transforming research 
data into more effective programs and services. It is essential that counselors 
focus their efforts toward research models and strategies that will have posi- 
tive benefits in the lives of students. ne ia 
An ecological or ecosystems approach represents a solid T tor 
both research and intervention in the field of college counseling. Such an 
APProach allows research to become a “way of life” for everyone a 
in Counseling services. It facilitates the setting of counseling goals a o ne 
tives based on the mission of the institution and the needs of stu | os 
development and implementation of useful programs and policies, and the 
ctiveness. In addition, it brings counselors 


€Monstration of 2 eife 

i ; Pisga ini 5s, S f. and other 
into a collaborative role with administrators, saoer ney a 
Members of the campus community. It allows counselors the opp 


€ seen as full partners in the demanding tasks of building mn 
ON campus and thus enhancing growth both for ose en Aa te 
igher education and increasing the value of counseling 3 
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CHAPTER 10 
Rehabilitation Counseling 
and Rehabilitation Research 


Dwight R. Kauppi 


t to the rehabilitation counselor is broad, just 
ation counselor is broad. Many forces have 
shaped the roles of rehabilitation counselors and the kinds of research that 
have been done that aid them in their work. This chapter delineates the 

omain of rehabilitation counseling and examines several of the major re- 
Search streams, with implications for the practitioner. Suggestions are of- 
fered both for using and doing research. 


The range of research relevan 
as the domain of the rehabilit 


THE DOMAIN OF 
REHABILITATION 
UNSELING 


always clearly distinguished from other 


Practices of counseling or guidance. If asked to tell what's different about 
rehabilitation the typical rehabilitation counselor will mention the work 
With “deviant” clients, the focus on client assets rather than liabilities, the 


emphasis on practical life-functioning goals, and the use of a multidiscipli- 
“i | he client. When it is pointed out that 


'y team i istic service tot 
these ee to rehabilitation (nor indeed are they pres- 
ent in every instance of rehabilitation), the typical rehabilitation counselor 
ont nonetheless insist that rehabilitation counseling is meaningfully differ- 
rom other kinds of counseling. 


Rehabilitati be 
When abilitation counselors May 


Bener 
resea 


Rehabilitati , 
€habilitation counseling is not 


wrong in many specific instances 


they insist that they are different. Still, rehabilitation counselors in 
al share many characteristics and these have many implications for the 


rch that is relevant to the task. For one thing, the rehabilitation 
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counselor’s clients are all “deviants,” persons who are in some significant 
characteristics well beyond the middle 50 percent of the population. be 
deviance may or may not be readily apparent, but is acknowledged by al 
clients in the act of accepting the services of a rehabilitation counselor. Just 
about all of a rehabilitation counselor's clients have objective re 
This is in contrast to many other counseling caseloads, where the cliente e 
may be healthy, financially secure, well entrenched and accepted in = 
mainstream, with many skills and advantages, but who feel a need i 
brings them in for counseling. As a result, rehabilitation counselors mus 
work with both intrapsychic and external problems. The intrapsychic reac- 
tions of a client are important, although the typical rehabilitation counselor 
may spend relatively little time trying to modify them directly. Leda sg 
problems often include the client’s view of self as a damaged person, ane 
ambivalence about trading an easy dependence for the rigors of trying. 
Other problems often present include: unemployment, pain, poverty, disfig- 
urement, familial rejection, social ostracism, the possibility of future disabil- 
ity or death, and all the other personal, medical, and social difficulties 
people can face. a 

In addition to working with clients, rehabilitation counselors work wi n 
many other persons and institutions. They must relate to a family that 1$ 
sometimes helpful, sometimes overprotective, occasionally rejecting. They 
deal with problems of the labor market, the economy, the insurance a 
workmen’s compensation laws, and the social services industry. They en 
cope with a sometimes hostile community. They must deal with the politics 


i iety of 
of agencies, local, county, state and federal government, and a variety 
professions. 


The methods available to rehabilitation counselors are similarly varied. 
They use, of course, the traditional individual and group counseling tech- 
niques employed by counselors in most settings. For many rehabilitation 
counselors, though, the “50 minute hour” in the office has been replaced by 
individual and informal sessions in a variety of locales: at the client’s home 
or place of employment, at a work evaluation station, in a patina 
center, or hospital—wherever the client is. The rehabilitation goe 
typically has access to various other professionals and paraprofessiona = 
with all their expertise and techniques. The use of so many ee 
necessitated by the different problems affecting many life areas presented . 
most rehabilitation clients. In order to integrate the work of all the specialis 
in a “holistic” manner, a team is necessary. saint 

The focus of rehabilitation is on the strengths and assets of the clien 
rather than on pathology and weakness. There is a subtle but significan 
difference between saying “this person can’t walk, except with crutches 
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and saying “this person can walk, with crutches.” The intent of rehabilita- 
tion workers is not making the client “well” or “curing” the condition, but 
rather achieving the highest level of functioning possible. As a result, the 
rehabilitation counselor’s interest in the evaluation of clients is in measures 
Of strength. 

So the answer to the question “What is special about rehabilitation 
Counseling?” seems to require several parts. Rehabilitation counselors gen- 
erally focus on the assets of their clients, work as part of a team concerned 
with the client’s total functioning, toward practical goals of independence 
and self support, and use a variety of techniques to help clients with many 
internal and external problems. Certainly some counselors who do not call 
themselves rehabilitation counselors would claim the same distinctions, at 
least some of the time, and some rehabilitation counselors would not always 
fit this description. Still, the description is generally more true of rehabilita- 
tion counselors than not, and can serve to guide a consideration of the 
research that is significant to rehabilitation counselors. 


RESEARCH RELEVANT 
O REHABILITATION 
COUNSELORS 


In an effort to give a flavor of the research literature without attempting a 
Comprehensive review, this chapter describes research relevant to the re- 
abilitation counselor in four categories: research on specific disabilities, 
rehabilitation counseling service delivery, rehabilitation constructs, and re- 
Search utilization. This listing is not exhaustive nor are the categories mutu- 
^ Y exclusive. Purposely omitted are the kinds of research that =e of en 
© Counselors in general, such as research on age n vonon 
Psychology, Some of that research is accomplished under the pa o 
rehabilitation funding, and gets reported in rehabilitation journals, but it n 
nor Considered here Also omitted is the vast amount of primarily medica 
"esearch, . 3 


nee 
Pecific Disability Research 
rest to rehabilitation counselors has 


s one on the rehabilitation of persons with specific ies pape 

€arch reported is generally on some special characteristic of the g p 

a as the handicapping effect of the disability, or the pate Rn 
OF social problems presumably shared by persons with that disability), 


A e 
ba Y large body of the research of inte 
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on some special techniques of rehabilitation useful with persons with that 
disability. This research is undertaken for a variety of scientific, practical, 
and political reasons. Some disabilities present severe social problems, 
either because they are widespread (such as mental retardation), or because 
they present very serious handicaps (such as quadriplegia). Public concern 
may lead to legislation that provides support for research on particular dis- 
abilities. Perhaps as important as any factor, the presence of centers and 
organizations devoted to particular disabilities stimulates and supports such 
research by political action, financial support, and access to data. 

Rehabilitation counselors may find their practices greatly influenced by 
some of the studies done with particular disabilities. For example, the disa- 
bility of mental retardation formerly was thought to preclude work and 
vocational rehabilitation. Even though mentally retarded persons were eligi- 
ble for vocational rehabilitation services, they were not accepted in large 
numbers. At the same time, studies were done and reported showing that 
many mentally retarded persons could work. One of the best known was the 
study by Baller (1936), which reported on a group of adults who had been 
classified earlier as mentally deficient. This same group was followed up 
later by Charles (1953), and even later by Baller, Charles, and Miller (1967): 
The results, like those of many other such follow-ups, show that many 
mentally retarded persons are gainfully employed. They may not, as a group, 
be earning as much as a comparison nonretarded group, but there are many 
individuals who are self-supporting and in other ways indistinguishable from 
the population at large. Their appearance may be a mask covering actual 
incompetence (Edgerton, 1968), but they certainly are, as a disability group, 
suitable for vocational rehabilitation, 

Mental retardation also offers many examples of research on special 
rehabilitation techniques. Often the programs demonstrated have to do with 
early identification and special education, special workshops, special tech- 
niques for behavioral management, and jobs that are uniquely suitable for 
the mentally retarded. These studies are likely to be reports of what has been 
done or observed in the field, leaving the usual questions that result when 
there are no real control groups or precise criteria. Still, most rehabilitation 
counselors might find such research to be very interesting, and a source of 
ideas for useful techniques. 

The research on other specific disabilities is surprisingly similar. There 
are reports that discuss the unique aspects of the disability; such research 
shows that, despite popular opinion, people with the disability can be re- 
habilitated. And there are reports of special techniques, and special prob- 
lems in working with that disability, usually including the notion that early 
identification and intervention are important, that specialists in the disability 


N 
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can do the best job, and that the attitudes of the counselor and the client are 
Important. 

A variety of physical and psychiatric disabilities have been the subjects 
of such research. Also treated as disability groups have been older disabled 
Workers (Muthard and Morris, 1961), welfare recipients (Hamilton and 


Muthard, 1973), and offenders. 


Research on Rehabilitation Counseling Service Delivery 


A large volume and a wide variety of studies can be included in the general 
Category of “service delivery.” There are studies to test one or another new 
(or old) method of getting rehabilitation services to clients. There are studies 
to establish the technology for assessing various aspects of service delivery. 
Some studies look at the work behavior, attitudes, and environments of 
Counselors and other rehabilitation workers. There are studies of the sociol- 
08y of rehabilitation. Of special interest to the counselor are studies of 
Counselor effectiveness and function. 
One kind of research effort of great importance to the counselor is the 
Search for better criteria of successful rehabilitation than the old-fashioned, 
Simple “closed-employed.”” One example of such a measure grew out of the 
Oods County project (Reagles, Wright, and Butler, 1972). They combined 
~~ Vocational and extravocational items into a scale that would yield a 
Single score, but would reflect more of a client’s rehabilitation status than 
Simple employability. In addition, they hoped to use the scale as an index of 
"ehabilitation progress, through the use of change scores. er 
tio The desire for a single score that would reflect more om just vága 
Nal success may be futile. Bolton (1974) used a factor analysis of meas- 
ures of client vocational and personal adjustment, to determine if mae was 
o h similarity among the measures to Just! ae ge je ea 
icy ee that the vocational dimension was indepen n x ge nn 
a dimensions, which suggests that they should be treated as separa 
Merja, Even i ly with vocational aspects may call for a more 
ee has developed a Case Difficulty 


Complex ; 
Plex index i VR (1972) ] 
s pa a pi rate as a measure ot counselor per- 


ions to the measurement: counselor 
erage difficulty of such clients. Thus, 


ustif 


tthe This index supplements closure 
tim nce, by adding two more dimens 


and eff the av 
ort, and a measure of the ¢ ( g 

Dencunselor who works with a severely disabled caseload ml ig 
alized fora lower closure rate. Despite all the efforts to find a 


however, the one most used is still the number of cases closed 


Se employed. 
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Generally, questions about what rehabilitation counselors do or what 
rehabilitation counselors are like are asked directly, by getting a sample of 
counselors and asking them in one way or another. In an emerging profes- 
sion, the results of such research can be important in providing practitioners 
with models, and with a sense of where they belong. The following studies 
are examples of interesting methodology or careful procedures. In an appli- 
cation of the critical incidents technique, Jaques (1959) asked each of the 
counselors in her sample to give examples of incidents in which they con- 
sidered their efforts to be especially effective or ineffective. The incidents 
were then analyzed. Among other results, Jaques concluded that within her 
sample of state agency counselors in several midwestern states, trained 
counselors were more likely than untrained counselors to see their counsel- 
ing function as important. 

Another major study of what rehabilitation counselors do and think 
was reported by Muthard and Salomone (1969). They used a carefully de- 
vised sampling plan to solicit respondents from around the country, so that 
their final group included subjects proportionately representative of the 
population as to employment setting, training level, experience, and geo- 
graphic distribution. In 15 large cities, a total of 378 rehabilitation coun- 
selors completed a number of questionnaires in two half day sessions. Ques- 
tionnaires included a rehabilitation counselor Task Inventory devised for the 
study, plus other special and standardized questionnaires to index job satis- 
faction, attitudes toward the profession, vocational needs and preferences, 
and a variety of other variables. The data pool was analyzed using factor 
analytic techniques, which the authors then examined for applications tO 
counselor preparation and role assignment. They suggest, for example, that 
the way task importance, desirability, and satisfaction responses clustered 
indicates that separate work roles might be established for coordinating and 
for counseling so that counselors with different backgrounds and talents 
could be used differentially. They saw evidence for role strain in the un- 
realistic role expectations displayed by many of the rehabilitation workers’ 
colleagues. Dozens of other hypotheses were tested and conclusions draw" 
on the basis of this large, carefully devised and collected data pool. 

_ A series of studies of rehabilitation counselors has been carried out by 
sociologists Marvin B. Sussman and Marie R. Haug, and their colleagues an 
associates at Case Western Reserve University. Most of their studies have 
been reported as working Papers (Sussman, Haug, and Trela, 1966; Sussman 
and Haug, 1970), but a concise report of some of their research on rehabili- 
tation counselor careers appeared in the Journal of Rehabilitation (Sussman 
Haug, Hagan, Kitson, and Williams, 1975). Using questionnaire survey 
techniques with sometimes phenomenal response rates (324 out of the 326 
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rehabilitation counselors graduating in 1965 responded to their mailed 
questionnaire), Sussman and Haug have taken a sociologist’s look at where 
rehabilitation counseling students come from and where they go, separately, 
as compared to other rehabilitation workers, and in the context of the New 
Careers movement. Their work has been both praised (Research Awards 
Committee of ARCA, 1971), and criticized (ARCA Research Committee, 
1973; Haug and Sussman, 1973). The most controversial part of their project 
has been the study of where rehabilitation counselors come from, and what 
happens to them when they complete their training. In their study of re- 
habilitation counselors who graduated in 1965, Sussman and Haug found 
that one-third had left the field of rehabilitation counseling within one year 
after graduation. Although there were many possible explanations, such an 
attrition rate could have serious implications for those responsible for fund- 
Ing and administering rehabilitation counselor training programs. Their find- 
Ing was criticized because of the restrictive definition of rehabilitation coun- 
seling used to determine who had left the field, and the lack of any compari- 
son with other professions. These criticisms were answered in their 1972 
Ollow-up of the 1965 graduates (Sussman, Haug, etal., 1975), which found 
that the combined proportion of “employed out of rehabilitation” and “not 
“mployed’’ was 10 percent for rehabilitation counselors, an attrition rate 
that was lower than all but 3 of the 13 disciplines studied. They found also 
that, compared to students from other disciplines, rehabilitation counselors 
“ame from lower social class backgrounds, made their occupational selec- 
tion later in life. were third highest in income, had the highest percentage 
Clainj ete tne vere third highest in propor- 
„Ming personal disability (23 percent), and were 
tion of blacks. 

There are many studies den 


Meth k , = 

Nod of deliveri habilitation COUNSC 

i alivering rehabilitatio! j z í eae 

‚oh Project febo rather than true experimental studies utilizing no- 
5, rd 


eatm u o ling shares with other service de- 
ent ation counseling Á : 
N aarapie. Rakes tail anse of doing such experiments. Like 


i ery s Pi sgg: z 
ystems in the difficulty and expe > 5 5 
he studies mentioned above, research on service delivery oe Pack in 
thoviding information on how rehabilitation counselors are used, what they 
N : ‘ follow. 
Nk, and what developmental history they follo 


nonstrating OF testing some aspect or 
ling. Most of them are demonstra- 


Research on Rehabilitation Constructs 
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any stuck _ 
teh Y Studies in rehabilitation could be 
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best categorized as research on 
i í isability, acceptance of 
. MDilitatio attitudes toward disa ; 

F n constructs such as $ et 
ability, and motivation for rehabilitation. There are many such constructs 
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used to describe the factors that influence the behavior of clients, families, 
employers, rehabilitation workers, and society at large. Of course, research 
includes many constructs of interest to all counselors, such as empathy or 
self-concept, as well as the ones discussed here as more or less unique to 
rehabilitation. 

The attitudes of people in general and clients in particular toward 
disability and disabled persons have long been considered crucial to various 
aspects of the rehabilitation process. A much used tool in research on these 
attitudes has been the Attitude Toward Disabled Persons (ATDP) scale 
(Yuker, Block, and Younng, 1966). The ATDP asks the subject to agree OF 
disagree with statements about the adjustment problems of physically dis- 
abled persons. In general, the scale is scored so that the more a subject sees 
physically disabled people as not different from other people, the more the 
score will be in the “accepting” direction. Many studies have been done to 
norm and validate the scale, and to establish the correlates of the thus 
measured attitudes. 

As with any deviant group, it is presumed that societal attitudes toward 
the disabled motivate much of the prejudicial behavior displayed toward 
them, so that learning more about such attitudes can help conquer barriers 
to employment and produce other benefits. Research with the ATDP has not 
always revealed such a powerful attitude as being specific to the disabled, 
but rather suggests that it may be a part of a larger ethnocentric attitude 
(Chesler, 1965). Another possibility is that such attitudes are multidimen- 
sional, with various social and personal components that may be present to 
varying degrees in different subjects in relation to different disabilities (Siller, 
1976). 

Issues regarding the nature of attitudes toward the disabled are studied 
because if such attitudes do indeed influence so much significant behavior, 
then the change and control of these attitudes becomes very important. 
Usually, studies of how to change attitudes are experiments that either pro: 
vide subjects with contact with disabled persons or give information about 
disability using ATDP score changes as the measure of attitude change 
(Evans, 1976). 

The “acceptance of disability” by a disabled person has long been 
considered as a significant determiner of that person’s behavior in the re- 
habilitation process. Sometimes the construct is used in the other direction, 
as when a client's adjustment is said to reflect “denial” of the disability. The 
construct generally is used to indicate where a client is in a process © 
adjustment, which is thought to involve the shifting of values and meaning’ 
away from a physical and disability centeredness to a broader perception 
(Wright, 1960). Despite its apparent importance, the construct has not been 
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much researc : 
eine is mos usually used clinically, often as an after-the-fact 
E ite client behavior. For example, a client who does 
eels ea Ls tet itation treatment will be said to be resisting because 
haere Rte isa bility. When measurement of the construct is required, 
oats Ana 3 used, on the presumption that disabled persons who have 
shies owa een disabled persons In general also have positive 

ie eier d themselves and therefore accept their disability. 

bikea s rer Acceptance of Disability (AD) was constructed by 
shi en 1971). He followed the suggestion ol Dembo, Leviton, and 
shifts ae nat the process ot adjustment to disability involved value 
sique, ce eas: enlargement of scope of values, subordination of phy- 
ainment of disability effects, and transformation from compara- 


tive 
2 values 5 A 
s to asset values. He wrote items to exemplify each area, resulting 


ina 50; 
Ite f . . . . 
em self-report questionnaire using a Likert scale. Evaluation of the 
ble. It showed a significant 


resulti 

and ee it to be adequately relia 
into four part al relationship with the ATDP. The separation of acceptance 
highly Be s Was not supported because the items based on each part were 
tor, correlated, and a factor analysis revealed only one sizeable fac- 
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19 Research and Training Centers and nine Regional Rehabilitation Re- 
search Institutes (Levine, 1970). When Muthard (1974a) compiled a bibliog- 
raphy of reports and articles relevant to vocational rehabilitation, the listing 
included over 6000 articles. 

In the beginning not much attention was paid to the growth of report 
literature. Some of the visitors to Washington, D.C., would bring back stories 
of the size of the room required to hold final reports from all the projects. 
Rehabilitation workers who read project reports complained about their 
length and turbidity. Occasionally, counselors would be amazed to discover 
that a rehabilitation research project they had never heard of but which 
sounded very interesting was being conducted at a university only a few 
miles away. 

Such observations and complaints plus the emphasis in rehabilitation 
on practical matters led to concern for developing ways of applying this 
research. In 1966, the Director of the Vocational Rehabilitation Administra- 
tion appointed a research utilization task force (Usdane, 1968). The Joint 
Liaison Committee (1967) of the Council of State Administrators ol Voca 
tional Rehabilitation and The Rehabilitation Counselor Educators held a 
conierence on the communication, dissemination, and utilization of re 
habilitation research information. At about the same time, a research utiliza- 
tion branch was formed within the division of Research and Demonstration 
Grants. A variety of programs were begun to find ways to get research 
information to the front line worker in a manner that would make it useful. 

Extensive listings of research resources have come from the Regional 
Rehabilitation Research Institute at the University of Florida. Their publica- 
tions include listings of experts in rehabilitation (Muthard and Crocker, 
1971), information centers (Muthard, Rogers, and Crocker, 1971), and re 
ports and publications of Research and Demonstration projects and other 
relevant HEW grantees (Bailey and Muthard, 1968; Dumas and Muthard, 
1970; Crocker, Muthard, Reinhardt, and Wells, 1973: Muthard, 19742). 
Efforts to get the research into a useful form have included a project to write 
easy-to-read summaries of research projects (Muthard, 1974b), and the use 
of audiovisual briefs (Engstrom, 1975). Efforts to get practitioners to use 
results have included the establishment of research utilization specialists in 
some state agencies (Hamilton and Muthard, 1975), visiting consultants 
(Butler, 1975), planned learning experiences (Kunce and Hartley, 1975), 
and other methods developed by the Research Utilization Laboratories (S0!- 
off, Goldston, Pollack, and White, 1975; Robinault and Weisinger, 1975). 

It follows that a field committed to research will look for research t° 
demonstrate the effectiveness of various utilization projects. An interesting 
study testing a basic assumption behind the need for research utilization 
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efforts was reported by Bolton and Soloff (1973). They examined the extent 
to which an employability scale developed at the Chicago Jewish Voca- 
tional Service was utilized, through searching the literature for references, 
Putting advertisements in journals, and mailing questionnaires to persons 
who had requested information about the scale. Although no extraordinary 
distribution efforts had been made beyond publishing the scale, announcing 
its availability, and publishing research reports, 48 practitioner and research 
applications of the scale were found. This led the authors to conclude “we 
Suggest that without change agents, more research results get put to use than 
utilization theorists now believe” (pp. 77-78). Although there can be no 
doubt that much useful research goes unused, the wall between research 
and practice must have some openings. 
What are the channels through which information passes? Muthard 

and Crocker (1975) collected data on the sources of information used by 37 
State-level supervisors in 11 state vocational rehabilitation agencies. The 
Journal most read by their respondents was the Journal of Rehabilitation. 
heir professional reading habits varied, with 20 percent having 75 or more 


volumes, and 16 percent fewer than ten volumes in their professional 
ibraries. When they needed professional information, most of them used 
Personal contacts, either with their own colleagues, or people with experi- 


Ence in other agencie Professional literature was not seen as very useful, 
for reasons that included the belief that their own problems are unique, the 
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gained acceptance, and brought about agency changes. Glaser and Backer 
report amore complete evaluation done through field visits, questionnaires, 
and document analysis. Their criteria were various evidences of impact, set 
in a conceptual or clinical approach to evaluation. They concluded that 
since the projects survived, were visible, had won endorsement, had af- 
fected system operation, and had produced other evidence of impact on the 
agencies, they were a valued new resource for some of the agencies. 

Butler (1975) reports an evaluation of the visiting consultant method of 
research utilization. A sample of 18 consultation visits was analyzed in 
depth, through either a visit to the agency or a telephone interview. The 
consultation was seen as helping satisfactorily, with the usefulness and satis- 
faction depending at least in part on the institutional characteristics of the 
agency, and on the user’s perception of the consultant. Sen 

Research utilization efforts in rehabilitation counseling have gone far in 
developing a variety of methods for getting research results into the hands of 
the counselor. More important, there has been a concerted effort to test the 
effectiveness of various dissemination and utilization methods and models. 
Although much remains to be done, the field of rehabilitation counseling 
has done a great deal to bring about a better understanding of how coun- 
selors can be helped to use research. 


EVALUATING 
REHABILITATION RESEARCH 


As a general conclusion of this survey of rehabilitation research, we can say 
that there are many studies that do have specific application, some generali- 
zations that are of limited help to the practicing counselor, and a few princi- 
ples that can be counted on. The practicing counselor probably does learn 
more of value from supervision and colleagues than from reading rehabilita- 
tion research reports. This rather pessimistic view of the impact of rehabilita- 
tion research is consistent with the results of an evaluation of policy-relate 
rehabilitation research recently conducted by a group of economists at Rut- 
gers University (Berkowitz, Englander, Rubin, and Worrall, 1975, 1976). 
They examined abstracts of rehabilitation projects done between 1955 an 
1973 to locate those in which an attempt was made to relate various service? 
to a change in client status. They located 477 reports, and collected informa” 
tion about each project’s methodology. Each report was then rated on a 1 
point scale on the adequacy of its scientific methodology, and its policy 
utility. Overall 44 percent of the projects were rated “poor” methodologi- 
cally, with only 17 percent rated highly. The usefulness of the projects IN 
setting policy was only slightly better, with 32 percent rated low and 
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by strangers at a university, but is performed every day by ordinary people. 
Most rehabilitation counselors already do some things approaching local 
research. Whenever anyone makes systematic observations in order to an- 
swer questions he or she is doing research, and it isn’t only Ph.D’s in 
laboratories who can and should do it. The typical rehabilitation office or 
center is full of questions and the data to answer them. If rehabilitation 
counselors can train themselves to look for data rather than speculating 
about answers, they can find many interesting and valuable research pro- 
jects. ; 

The local research projects done by the rehabilitation counselor will 
probably not be the same as those conducted by full time researchers. The 
practitioner will be wise to avoid studies that would involve instruments that 
require computer scoring or extensive statistical analysis. Similarly, studies 
that depend for their value on generalization to large populations, or that 
utilize complex inferential statistics may be beyond the practitioner's ability. 
But even after such projects have been eliminated, many studies remain to 
be done by the practicing counselor. Such local studies can include looking 
at tools, resources, procedures and practices, caseloads, and the characteris- 
tics of people and groups in the community. 


Specific Local Studies 


Most of the tools used in vocational rehabilitation do not have local valida- 
tion. For some, national studies have been done and it is presumed that the 
results apply to local situations. In other cases, research was done at the 
place the tool orginated and is applied elsewhere on that basis. Too war 
tools are used with no data whatsoever as to whether they are actually usefu 
to the counselor. Local research can supply some useful and interesting 
data. 

For example, most work evaluation units use a variety of job samples 
tests, and tasks to evaluate the vocational potential and ability of thelr 
clients. Counselors who use the units generally get impressions of the rela- 
tive usefulness and validity of each of the tasks. Sometimes counselors fee 
that certain tests are very useful in evaluating potential for certain kinds © 
jobs, and ignore client performance on other tests. The effective use of 4 


: > z h h- 
work evaluation unit can be improved with answers to a variety of researcl 
able questions including: 


; ; ing: 
Which tasks are seen as most useful by the work evaluators? rehabilite 
tion counselors? clients? potential employers? 
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Are the tests administered in a standardized manner? 


Would a change in instructions make a substantial change in client 
performance? Does it make a difference in client performance if the test 
is completed alone or in a group of clients? At the beginning of the 
client’s stay, or later? 


Is there a relationship between client performance and age? sex? educa- 
tion? disability? Any other demographic or experience variable? 


days after they took it the first 


If you gave clients the same test a few 
ave them the test 3 or 4 


time, would they get the same score? If you g 
times in a row, would their scores go down or up? 


The answers to these questions are often already sitting in the agency’s 
data files, waiting to be put together. In other instances, all counselors need 
to do is get the cooperation of their colleagues in keeping a few notes, 
Making a few observations, or answering a few questions. Answering ques- 
tions such as the above can increase the usefulness of work evaluation test 
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questions regarding resources. Local resources often get reputations ne. 
tain kinds of performance; when such reputations are based on unveritied 
hunches rather than data, an opportunity is raised for local research. For 
example, some trade schools get a reputation for building their en rollments 
by guaranteeing placement to all graduates, accepting anyone who applies, 
and withholding final graduation from all clients they cannot place. Such a 
reputation could be investigated by examining the files of the local state 
vocational rehabilitation office to answer the following questions. 


How many clients have been referred to the school? How many have 
been turned down? How many have graduated? How many have jobs 
for which their training was relevant? How long were the nongraduates 
retained as students? 


Similarly, some rehabilitation facilities have the reputation for “cream 
ing,” that is, accepting or working only with easy-to-place clients. Some 
facilities get a reputation for being especially effective with particular client 
groups. These kinds of reputations could lead to studies that asked questions 
in a way similar to those asked about the school. . 

Local studies of resources can be done only where the rehabilitation 
counselor has access to appropriate data, such as a state vocational rehabil a 
tation office. There is a danger, too, that the data might be used unfairly, OF 
that the resources being so studied might object. Such studies must be 
conducted carefully, but it should be the case that systematically collect 
data are less dangerous than uninformed speculation, 

Counselors who work in small offices, or who have only their own case 
files to examine, will be limited in the kinds of local resource studies they 
do. It may still be valuable for them to collect such data as a basis for their 
Own opinions, but ordinarily one caseload is not enough to form conclu- 
sions about the utility of a resource. f 

Another fruitful area of local research is the practices and procedures © 
an office or other work unit. Here too, coffee break conversations can ap 
vide questions to ask. Practically every new operating procedure ihat 
instituted stirs up a variety of opinions concerning its effect. Too often, thes 5 
Opinions don’t get beyond the talk stage, and the new procedure become 
an old procedure with no check on whether it did what it was supposed oe 
A research minded counselor might find it very interesting to convert som) 


of the opinions into a form that allows the collection of some data, SO tha 
the procedure can be evaluated. For example: 
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Does a new method of getting general medical examinations result in 
reports that are longer, more detailed, or more useful by some judg- 
ment? Do they come more quickly? 


Does a new system of referring clients for vocational testing result in 
More counselors using the service? Are more tests given? Are the coun- 
selors satisfied? Do they still use testing at the same rate six months 


later? 


Does a new system of maintaining case recording on clients result in 
more up-to-date notes? longer recording? more detailed records? Are 
= counselors satistied? Do they still perform the same six months 
ater? 


Does a new procedure of in-service training actually lead to more 


Counselor time spent in training? Is the time equally distributed, or are 
some counselors doing it all? Are counselors more satisfied with it? Do 


they know more after the training? 


al counselor. Professionals who 
hods might think of many kinds 


data that would be useful. Some agencies with access to computers 
of caseload information, such 


iio give counselors feedback on a variety of cas N + 
Eu. umber of cases in each status, the length a time spent in each E 
their o on. Counselors who do not have access to computers can collect 
as: OWN Information, to answer questions about their own caseloads, such 


The unit of interest can be the individu 


wis A 
of h to learn something about their own met 


How many clients are interviewed each week? Are some clients seen 
More often than others? What kinds of clients are seen more often? less 
often? About how long is the average interview? What is the topic of 
Ong interviews? short interviews? 

How many different rehabilitation plans are developed? How many 
different vocational goals? How often is the job at closure related to the 
Original vocational goal? Is there any evidence of stereotyping of re- 


habilitat: 3 
Nabilitation plans? Vocational goals? 


Does making regular stops at a referring agency increase the number of 
referrals? Does a personal letter to the physician speed the medical 


Teport? Does a detailed letter requesting information needed from a 
Specialist result in a more comprehensive report? 
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f i i is in 
What activity takes up most of the time? How much time is spent 
what might be called counseling? clerical work? placement? 


Caseload characteristics and their changes are also a fruitful source n 
local research data. The task is made much easier when the data are m 
lected routinely and processed by a computer, but even a lone counse : 
with a hand calculator can collect the data to answer some ee 
Keeping case summary data on a file card or sheet makes it easy to sit u 
once a month or so and sort the cases into various categories. This allows 
counselor to keep track of such caseload questions as: 


h ag 

š ur se n à is 2 sexs 
What are the basic characteristics of the caseload, in terms of ee 
marital status? ethnic background? education? number of dependents 
disability type? source of referral? age at disablement? 


Have these basic characteristics changed appreciably? Have me 
changes followed a change in the regulations, office procedures, A. 
practices of the counselor? Is any disability or other group of clients 
increasing or decreasing in proportion? 


A final area of local research pertains to the characteristics hen 
community. The community studied could be as small as the staff ot a in 
office, or as large as a major city or state. Coffee break conversations ek 
are a source of questions that interesting data can be collected to ane 
The technique used will often be a survey questionnaire, but the ingen dy 
researcher will find many other sources of data, including some dea 
available. Some time spent learning sampling techniques could save m 
effort. Data can be collected to answer such questions as: 

ion 

Do the employers in the town know anything about affirmative geu 

legislation? Is their knowledge related to the size of their company’ 5z 


a F cting’ 
any similar factor? Of the employers who know, how many are à 
What are they doing? 


ay use 
How many vocational rehabilitation agencies in this comm a memi 
paraprofessionals? What do they use them for? How do they hir 
Are they satisfied with their performance? 


un“ 
How many self help groups are there for the disabled in this Ear one 
ity? Are they mainly single-disability groups, or do they admit a the 
who is interested? What needs do they see as most important 
community? How do they function? 


REHABILITATION COUNSELING AND REHABILITATION RESEARCH 311 


Many might object to calling such local studies “research,” and they 
may be right. We have not, it is true, said anything about the hypothetico- 
deductive system, the statistics of inference, parameters, or Graeco-Latin 
squares, What rehabilitation counselors discover doing local studies will not 
change the course of the profession, and they will not create much in the 
way of universal knowledge. But if examining data is better than specula- 
tion, and if rehabilitation counselors in doing local studies gain knowledge 
about their own practice and learn something about research, then these 


Studies are worth doing, whatever they're called. 


Doing the Study 


Obviously, no universal procedure for doing local studies could be given. A 
few suggestions are in order, however, since most research reference books 
Offer considerably more advice than the beginning local researcher is able to 
Use, 


1. It is a good idea to specify the questions in advance, and to spend 


Some time refining them. It may be easiest to start with a coffee break 
statement, such as “mentally retarded clients seem a lot easier to place on 
Jobs since the local ad campaign.” Before any data can be collected, that 
Statement needs to be refined. First of all, who is meant by the reference 
Mentally retarded’? Just those people who have “mental retardation, = a 
Primary disability in the state VR caseload? What is meant by a un 
ere are more clients placed? That more job openings are availab oo na 
there jg less apparent resistance by employers? That A wi ng 
to work? What is the comparison group? What about jobs’? Does this 
include sheltered work? On-the-job training? Jobs outside of those tradition- 
Ally reserved for mentally retarded? When is “since the local ad campaign’? 
ee the question imply that the ad campaign was effective in increasing 
Ployer acceptance? rs 
After ort cal reek the question may be more on the in of “the 
er of clients with M. R. as the primary disability on the loca 7 ee 
Oad who have been closed as rehabilitated in competitive work in the 


Case 

loca Community is larger for the period July 1 to December 31 Te it = 

tio the same group during the same period the pa year. the qu 
ON is still one of interest, then the next step can be taken. AR 
a 2 If the question is carefully specified, then the data to be collec e 

Mali De easily described. In the example cited, closure rates are the basic 

qota, and the specific zain to be made are readily determined. At this stage 

i Counselor-researcher may discover that although the data needed are 


Dum 
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clear enough, they are not available. If this happens, and no substitutes can 
be found, then it is probably necessary to start over with another question. 

3. The next step is to collect the data. In general, it is best if the data 
collection can be built into a routine system, or if the counselor-researcher 
can do the collecting. If something can go wrong, it will, and what may 
seem like the simplest instructions will get impossibly garbled. Data requir- 
ing subjective judgment is acceptable, if it can be shown that other equally 
trained judges would make more or less the same judgments. Avoid compli- 
cated questionnaires and indirect paper-and-pencil measures of constructs 
hardly anyone understands. When in doubt, collect the data that are sim- 
plest and most directly related to your question. To avoid a kind of contami- 
nation, with some studies the data should be collected and stored without 
being examined until the end of the project. 

4. The “simplest is best’ method is recommended for examining and 
analyzing the data as well. The first step is to look at the data; if they look 
significant, they probably are. Such a procedure would make many statisti- 
cians and researchers wince, but with local studies the small differences that 
may achieve statistical significance with the right manipulation probably 
don’t have practical significance to the local counselor-researcher- 
course some statistical analysis may be unavoidable or even desirable, in the 
form of means, standard deviations, and maybe even some correlations. An 
on occasion a statistical test of significance may be used. But it is rare that 
the counselor-researcher who has done a careful job with the basics w 
find occasion to use complex statistics. 
vio a ad 
discipline and gives closure t ee net a 

et de o a process that might instead just peter M 
> oe a reinforcement for the counselor-researcher and those who con 
2 flip systematic thinking about the subject. And if the ape l, 
en ye significant, then a write-up makes it more likely to be u 
or Mn ma en journal is always a possibility even for local "© 

3 7 well done and the results are interesting. d 
tes Bt p last step is to plan the first step of the next stu ” 

unt the mistakes that were made this time around. 


CONCLUSION 


Sr a ei for the rehabilitation counselor as it is for all a 

counseling ae counselor has an interest in all the reseal@ ys 

role in iat oe research pertaining to rehabilitation and the counse $ 
process. Research relevant to rehabilitation counseling is €% 


REHABILITATION COUNSELING AND REHABILITATION RESEARCH 313 


sive, but difficult to find and apply. Despite that difficulty, the rehabilitation 
counselor cannot totally delegate the responsibility of reading that research 
and applying it to practice. To ignore research dooms the counselor to 
committing and perpetuating the mistakes of others, using modern versions 
of bloodletting because someone recommended it. 

Counselors can do research on local problems and issues of interest to 
themselves and their colleagues. The value of such research lies not so much 
in how well it mimics large-scale science as in how well it answers ques- 
tions of local interest and how well it confers understanding of research. 

Rehabilitation counselors are by training and experience a combina- 
tion of idealist and pragmatist. They seek the best for their clients, with a 
focus on the functional. Such an approach fits well with research, which 


seeks truth through a focus on data. 
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CHAPTER 11 
Research in Employment 
and Vocational 
Counseling Agencies 


Wayne P. Anderson 


Employment and vocational counseling agencies are living research 
ke use of the special opportunities 


aboratories waiting for someone to ma i 
they present for studying the world of work. Their potential, however, re- 
malis largely untapped. An examination of the research reports in the voca- 
tional journals shows that most vocational research has been done in 
academic settings and few studies have been done with the clients of agen- 
cies (Holcomb and Anderson, 1977). College sophomores do not have the 


šame vocational choice problems as employment service applicants, and 
Counseling methods effective with highly motivated college students may 
not be so effective when used with a ghetto client in a work incentive 
Program. Counselors working in these agency settings are In a position to 
ind the answers to important questions that are of concern to their clients. 

ang „P employment and vocational counseling agencies, data on applicants 
end the world of work are available or can be collected somewhat easily. 
rom these data descriptive reports OF reports based on simple research 
Methods can be prepared that will be useful not only to the staff in that 


"Bency but to staff in other agencies with similar clients. fans 
res his chapter is not intended so much for the full-time or .. 
archer as for the counselor or other worker in an agency Wn + 
Oyment or vocational counseling is done. Because of direct contact Wii 
ang daily problems of clients and applicants, the counselor 2 pe a 
SWer Meaningful questions that the professional researcher does n 

t out the issues that must be consi- 


Coy 

nter, Thi ue e 
dere, C} This chapter is designed to PO i 
Wha n doing se and to suggest some relevant topics as examples of 
i his or her own agency. 


the reader might investigate in 
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A researcher who is primarily a counselor will need to be attuned > 
practical questions, and the answers arrived at should make one ie sso 
derstanding of and helpful to clients. Questions may be about client c a 
teristics, methods of counseling, effects of training programs, and 
on—“What is the effect of age on an applicant's continuing in a ee 
program?” “What is the most frequent reason new employees quik lon a 
“What ability level is needed to complete LPN training? The awen e 
questions of this nature will help in planning with clients and assure the 
resources will be used in the most economical fashion, = 

In this chapter, frequent illustrations are used from articles on emp oy 
ment and vocational counseling. The articles quoted are intended not i A 
to show how a particular researcher went about answering a question, bu 
also to serve as an introduction to the kinds of problems that people voikin 
in employment and vocational counseling agencies are presently concern 
with. l 

Not all of the studies cited in this chapter will meet the criteria for 
good, generalizable research outlined by Harmon earlier in this book. There 
may have been too small a sampling of subjects, the expertise of the coun- 
selor may be in question, or some other factor may make the data such that 
the results are of no more than local interest. Although some of the studies 
chosen for this chapter may therefore be inappropriate for publication in a 
national journal, they were selected to demonstrate studies that can = 
carried out in an agency to Provide useful information for dealing with loca 
problems. Often the results of these studies can be published in a newsletter, 


in agency reports, or shared at the various meetings that agency people 
attend. 


My experience h 
counselors from doin 
comfortable with hu 
many studies require 
ample, descriptive dat 


as been that statistics is fre 


quently the factor keeping 
8 More research. Perh 


e 
aps Counselors tend to be mor 

man relations than with numerical ones; however, 
the use of only simple statistical procedures. For ex- 


t a often require no more than averages or percentages- 
When comparing relationships between two factors, such as a score on 4 
test and supervisory ratings, a rank- 


necessary; in most other cas 
cient. If there is a question whether the difference between two groups OT 
between test scores is signifi 

and product-moment correl 


like me, consult someone who knows how tO 
program problems for the computer 
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We shall discuss (1) the general problems involved in designing a 
study, (2) methods of collection of information or facts for analysis, (3) 
methods of judging the effectiveness of a program or counseling method, (4) 
some human differerices that influence work behavior, and, finally, (5) some 
important areas for further research. 


APPROACHING RESEARCH: 
DESIGNING THE STUDY 


For our purposes two major classifications of research exist: descriptive 
research and experimental research. Descriptive research often makes use of 
Information already existing and which can be examined with a minimum of 
effort to discover characteristics of a group Or relationships between groups. 
Experimental research involves those situations where a counselor can con- 
trol, change, or influence specific events or procedures to discover the 
effects of such factors as a new counseling technique on the outcome of 
Counseling. 


Descriptive Research 


In descriptive research a counselor can make a straightforward a 
Statement of something that exists without having to compare it with so 


thing else, A purely descriptive study ina community agency was ee 
Sollinger (1970) on clients’ expectations of what they could receive in the 
ollinger used the closed files 


aY of servi f In this case, $ 
„Pl services from that agency. In this Case, ) š 
Ot his agency as his source of data. He took 300 clients who had registered 


IN one year and categorized and counted their reasons for coming. = 
Major conclusion was that the agency’s clients saw itas a place to be test 
And to get specific help and advice. They did not recognize the ae apa 
e to get counseling. The implication of this study was that c = may 
Actually want or at least expect a more limited service than an agency is 


and will; 
illing to id 
Mae is of way to start 
ee a ay me A ee yervice?” 
Swerin 5 “What do clients We S ? 
“ 5 s as: na i 
Where do en ke aaa from? is the educational re oa 
: j ist i ies’ files. 
Ur clients?” Data of this nature already exist in Be al 
At other times it may be valuable to compare local data v ne 
j tablish trends. Lauver, Gastellum, 


Or st 
o, Sh pt ae ions used in the Occupational 
d ethnic origins of the persons 


ie) 


Sut heehey (1975) examined the illustrat 
Ook Handbook to see the sex, age, an 
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pictured. They then compared these percentages with the percentage ke 
each group in the actual work population. This allowed them to i a oo 
estimate of the amount of bias that exists in the occupational material, ale 
is presumably an influence on young people’s attitudes toward VERSES. 

In the two studies cited above the authors were able to make use A 
data already in existence. There are times, however, when the data do n 
exist, and the next step is to set up some method of acquiring them. adii 

One method for getting descriptive data is the survey. This be “| 
involves developing a questionnaire or structured interview to find out = 
attitudes or conditions exist. These tools might be used with counse ite 
companies, ex-clients, or others. For example, Harkness (1971) was ref 
cerned about the hiring practices of government agencies and industria! 
firms as they related to various types of handicapped people. He was na 
terested in establishing the reasons these agencies and firms give for = 
hiring the handicapped, and how realistic those reasons might be. au 
surveyed 280 agencies and firms who had interviewed job candidates at t 
Northern Illinois University Placement Bureau during the er 
academic year, asking about their hiring practices regarding people with 
diabetes, epilepsy, hearing loss, and visual deficiencies. ; 

A more elaborate form of descriptive study makes use of correlations. 
Correlational studi 
rol what happens and yet wants to 
ts or factors. The most used correla- 


‚ General Aptitude Test Battery) and a person 5 


pi : task. Super and Crites in their book 
Appraising Vocational Fi ive hundreds of these correlations: 


ery (GATB) 
School Equivalency Test (GED). They wanted help in deciding which pel 
sons were ready to pass a high sch 


ool equivalent examination without 
further study, and who were likely to profit from further study. From this they 
developed an expectancy table that the counselor could use to help educa 
tionally deficient clients decide what they ought to do about taking the high 
school equivalency test, 
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Putnam and Hansen (1972), using more sophisticated forms of correla- 
tional methods, studied the relationship between self-concept and voca- 
tional maturity in young women. On the Tennessee Self-Concept Scale, 
people with high scores see themselves as having value and worth, and 
people with low scores see themselves as undesirable, and often feel anxi- 
ous, depressed, and unhappy. Scores from this test were correlated with the 
Crites Vocational Maturity Inventory. Their results indicated that a woman's 
self-concept was useful in predicting her vocational maturity. The authors 
do point out, however, that most of the variance on a vocational maturity 
scale is associated with factors other than levels of self-esteem. This points 
up the fact that many factors influence vocational maturity, and other studies 
could be done exploring what these factors might be. 


Experimental Designs 


ontrol some aspect of the environment, such 
an individual or the way in which facts are 


Presented in a class. This allows us to systematically manipulate the influ- 
ences or factors we wish to study. Usually there are two groups: a control 
8roup, for whom things are done on a routine or usual basis, and an experi- 
Mental group, who are subjected to special conditions. This allows us to test 
Ways of improving our counseling techniques or training methods. The most 
nae statistic used in these studies is a t-test or some elaborate form of 
"est such as analysis of variance. j 
When one is VOKTE with training techniques, these studies can often 
be done with a minimum of additional time committed. That is, this research 
can be done with programs that are scheduled to run anyway. 
For example, Keil and Barbee (1973) used 16 persons in an experimen- 

‘al group and 12 persans in a control group to investigate the influence of 
job interview training on the interview skills of the job applicants. All of the 
Persons being studied took part in a pre-training interview to establish en) 

ey Usually behaved in an employment interview. For the experiment, 
Broup, this was followed by training on specific skills that personnel sta 
ave indicated are important in impressing an ee 
*Vorably, A follow-up interview situation with both the experimental an 
Control groups showed that a significant improvement had occurred in the 
SXperimental group in their ability to impress an interviewer favorably. F 
ei In the Keil and Barbee study, conditions were organized 7 nn 
5 Ect of training versus no training. The study was short term and its 

“Te the result of a few hours of training given to 16 people. 


We are often in a position to € 
as the type of training given to 
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In some situations we may intervene in a program already a a 
modify one factor for some groups. This gives us a larger ee a 
an opportunity to apply our methods overa longer Berioe : T a 
investigated a new method of providing occupational know eag Re 
grade classes. Four schools that were already teaching occupa o a pineal 
mation classes were chosen for the study. Two were assigned the x} a 
mental condition, which was the presentation of an cy ari tt 
20-minute videotape followed by study and discussion. The two sc see ; roe 
served as controls used a more traditional method of reading about the a 
occupations in nationally produced materials and then discussing aga oe 
effectiveness of the methods was measured by pre and posttests p a 
accuracy of the students’ images about the occupations studied. It was GEF 
that the use of videotape presentations helped students gain a more accure 
picture of what happens in an occupation. nih 

Combinations of methods may also be used under controlled ar 4 
tions. Petty (1974) considered the effect of various combinations of ora an i 
written instructions on the understanding of disadvantaged trainees lea ‘dikes 
industrial skills. By presenting oral and written information in four comam? 
tions, he concluded that one must be quite cautious in the use of ue 
instructions with disadvantaged clients. One of his findings is that the bes 


way to give relatively easy job-related information is to deliver it orally. 
Sometimes it is necess 


so that they are not aware ol 


s ce in 
asked to react to a series of itema a 
to a variety of situations in the orga! 


€ re versions, so as 
of the characters. That is, some of the m 


anagers were making decision® 
about a worker who was described as a man: other managers were making 
decisions about the same situation, but the worker involved was described 
as a woman. Their findings support the statement that there is discrimination 
against women in decisions related to promotion, development, and supe" 
vision. 


i o 
do this when we have some eae 
some factors but may not be able 


N 
N 
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manipulate others. In some situations we are not able to set up a control 
group because of the difficulty of refusing service to some applicants. 

Occasionally, the researcher is in a position to observe some variable 
over a period of years in a longitudinal study. Kapes and Strickler (1975) 
studied changes in work values between the ninth and twelfth grades as 
related to the kind of curriculum that the students were involved in. The 
Occupational Values Inventory was used to study the work values. Kapes 
and Strickler found that five of the seven work values did change over a 
at least some of this change appeared to be 
as studying. They also observed that the value 
atest increase and that value intensity changed 
eak values grew weaker. 


three-year period, and that 
related to what the student w 
placed on salary made the gre 
So that strong values grew stronger and w 


TOOLS FOR RESEARCH: 
HE COLLECTION OF DATA 


As should now be clear, facts and data can be gathered in a number of ways. 
ays of gathering data in an agency setting are: (1) the 
scales and questionnaires, and (4) tests. Al- 
arately, they are often used in com- 
f the criteria discussed in the 


The most frequent w 
Use of files, (2) interviews, (3) 
though these methods may be used sep 
bination, either with each other or with some oO 
Next section, 


Files 


information is stored in files, only waiting for some- 
es to ask the right question for them to divulge their answers. Biographical 
lit on application forms or intake sheets can serve as a source of 

Ms to relate to counseling outcome, placement history, and so on. Often, 
a scoring system based on these data can lead to more accurate predictions 
than tests or scales. At the present time, a number of groups have made 
attacks on the use of tests in employment situations because it is felt that tests 
Are not fair to all groups and lead us to refuse persons positions in which 

EY might have done well. It may, however, be just as damaging to both a 
Company and an individual to place a worker in a position where failure is 
ikely. This problem of appropriate selection procedures has increased the 
Need to find alternative ways to help people determine the best fit between 


elr talents and employment. 
Na Ae results of counseling € 
gle (1973) studied the number of counselor € 


In : 
Most agencies, much 


an also be studied using file information. 
ontacts with disadvantaged 
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applicants and compared that information with later success on the job. ne 
data for his study were collected from the records of 333 disadvantage 
applicants in the Columbia office of the Missouri State Employment Service. 
He used client status as a criterion; that is, whether the client was a 
inactive, in training, or employed. His results indicated that there might wel 
be a “magic” number of counseling contacts, between three and five, 
beyond which clients were not likely to be significantly helped. He eon 
cludes that in dealing with disadvantaged clients, any case carried beyon 
seven contacts should be given careful scrutiny. Similar studies could be 
done in almost any agency to provide norms about that particular agency's 
clients, or even to study how specific methods used by different counselors 
may have affected their clients’ later experiences. 

Predictive studies could easily be done using the files by going back 
and checking out what the difference was between those clients who were 
helped by the services rendered and those who were not. 


Interviews 


Although files already contain data from interviews, there are situations 
where special questions must either be included in the regular interviews aS 
a way of collecting information on specific aspects of client behavior, OF 4 
special interview must be developed for getting the information needed. I 
terms of special questions, for example, if a counselor was interested in 
studying the effect of early role models (e.g., parents) on later vocational 
aspirations, he or she would include questions covering this in the regular 
employment interview or Counseling session. 


On the other hand, one May wish to conduct interviews to collect 
specific data for a study. An 


foll i xample of this use of the interview would be a 
ottow-up interview of persons who had had counseling to find out ggas 
infl d thei : what was their evaluation of how counseling 
inftuenced their behavior. Reich (1973) studied the relationship between 
ee ( school and eventual occupational placement 
: ieee with former students two to two and a half years after 
they had le om a He was able to contact 60 percent of the sample to do 
interviews with them about their occupational and educational experiences 
laedit Hel ° found that 52 percent of these ex-students v 
emp! si T ields relating to their high school training. The author wen 
one a however, and found that, if placement in clerical and sales 
are excluded, only 18 percent of the respondents were employed in jobs 
se work. This additional step provides informa- 
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tion that makes one question the value of high school training for later 
vocational placement. On the other hand, it leaves open for research the 
Questions: How can we make training more relevant? What kind of counsel- 
ing would have resulted in better placement? Does it make any difference to 
people if their high school training does not relate to later occupational 
placement? 


Questionnaires and Scales 


It may be difficult to make a complete discrimination between question- 
Naires, scales, and tests; however, for our purposes questionnaires are those 
devices that deal mostly with attitudes, preferences, values, and indications 
of satisfaction, but do not have much formal statistical foundation. Scales are 
questionnaires where the items have been scored or ranked so that a subject 
taking the scale can be placed on a continuum. Some sample items from 
different points on a scale are: “I can never find out how | stand with my 
boss,” "On the whole, the company treats us about as well as we deserve,” 
“lam made to feel that I am really a part of this organization.” In terms of the 
and scales available in the area of occupations 
arrassment of riches to choose from in 
especially valuable. The best 
s, is Measures of Occu- 


Numbers of questionnaires 
and vocations, one has almost an emb 
oing research. Two sources of scales are 
Source, for the purposes of those working in agencie i 
Pational Attitudes and Occupational Characteristics (Robinson, Athanasiou, 
and Head, 1969) available from the Institute for Social Research of the 
niversity of Michigan at Ann Arbor. This handbook not only provides 
"eviews of some of the important literature, but in addition presents 72 
Scales that can be used in employment and occupational studies. These 
Scales are evaluated in terms of the language that they use, their relevancy, 
and reliability, validity, and other statistical concepts. Among other classifi- 
Cations are: general job satisfaction scales, scales for job satisfaction for 
Particular occupations, occupational value scales, work-relevant attitudes, 
and Vocational interest measures. ; 
_ For a study of other variables, such as self-esteem, dogmatism, values, 
attitudes toward people, there is Measures of Social Psychological Attitudes 
Obinson and Shaver 1973) from the same Institute for Social Research. 
If the sea ease or questionnaire for the research purposes 
Selected does not exist (see the list in Appendix A), counselors will need to 
Evelop their own. As an example of a study of this kind, Bingham and 
Suse (1973) were interested in the accuracy with which counselors viewed 
Omen and work. They developed a 25-item scale of factual information on 
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the subject and mailed it to secondary school counselors in New Jersey. This 
questionnaire included such items as “On the average, women spend about 
25 years in the labor force” (true), “Approximately 40 percent of American 
women who hold college degrees never marry” (false). Counselors were 
found to have accurate information on only 12 of the 25 items, and women 
counselors were found to have more accurate information than men coun- 
selors on every item tested. 

An interesting use of the Neuroticism Scale Questionnaire was made 
by Schneider and Stevens (1971) in a study on the personality characteristics 
associated with job-seeking patterns. The particular scale used measures ot 
assertiveness and passivity. Their initial exploration found that patterns of 
job-seeking behavior were related to the personality dimension of 
submissiveness-dominance. In their sample they found that assertiveness 
and independence were associated with positive job-seeking behavior, and 
that passivity and dependence were associated with a low readiness for job 
placement. 

In studying such topics as vocational matu rity, vocational interests, and 


V i j a é à a 
oO values, job scales and questionnaires are particularly appr 
e. 


Tests 


le where the classification of scales ends and that of tests 
' Purposes, tests contain items that have right and wrong 
ms for comparative purposes. The most fre- 
ment settings are likely to be some form = 
à ence te i ies f we 
scales and tests but in eS Woe oe ee ee oe ee 
f Buros’ Mental Measurements Yearbooks 
‚ Highland Park, N. J.) to help in choosing 
collection of tests available for use an 
ing test research program, such as the 
tery (GATB). has with the General Aptitude Test Bat 


A , 
unanimous Supreme Court decision in 1971 (Duke Power case) 


Ip must be established between test scores and jO 


decision-making. We need Or counseling purposes as an al 


5 è to verif € f F icu- 
lar clients with whom we work y any test's value for use with the part 
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de oo. examine the test itself, but most frequently the test is used 
Simple or sere some underlying characteristic of the client. An example of a 
(97a) on the anng study of the test itself was done by Kapes and Sievert 
GATB a. of plastic pegboards as opposed to wood pegboards on the 
tls was heer pate dexterity (M). A ninth grade class of 1050 boys and 
feirerisel at he . Students who were tested using the wooden boards per- 
than did 8 icantly better (an average ot 11 converted score points higher) 
i students tested on the plastic board. 
ia ee a - John’s (1970) study isan example of how to use a test 
havior. ie fe a basic characteristic to make predictions about later be- 
Priate for wd ie t that many of the tests available to counselors are inappro- 
subprofession se planning to enter employment in technical, business, or 
choose an 5 occupations. They wanted to find a test to help students 
nesota Voc te various two-year terminal programs. They found the Min- 
diferenta iana! Interesi Inventory (MVII) to be an effective instrument for 
inding sating the interests of students in these programs. An additional 
related remit nat the student’s choice ot career appears to be more closely 
OF Valuable hat he likes than to what the individual believes to be important 
PP use of tests is as pre and as 
the follow curs as the result of counseling or trainin 
‚ing section on criteria. 


postmeasures to determine if some 


ch 
g. This use is included in 


CRITERIA 


a counseling technique or the 
ust have some standard against 
lled the criterion and it is 
ilable data can be com- 


ife 


arı ieh P 
adequa e to evaluate the effectiveness ot 


ac f Sr un p 
acy Of a vocational interest scale, we m 


Nich 
to measure success. The standard used is Ca 


Som 

em 3 : 

Pared en or judgment against which aval 

4 Such questions as : “How good is an innovative training program?” 
will be answered only if we can 


ow eff 
effective j : ” 
ome y fective is a particular agency? ered 
P with some measure of “goodness” and “effectiveness.” Often, 


Sstablich: 

ablishing criteria is a matter of counting Or compiling numbers of place- 
tings, or test score changes. 

de by an agency May be by itself a weak 
or be fired shortly after beginning; 
ould be better. For example, 
ree months or more? Varga 
aper on counselor charac- 
placed if successfully 


S el training dropouts, job ra 
Criterio € number of placements ma 
there a because some clients will quit 
aoe thes some measure of job continuity W 

1974 ü ny applicants remain at a job for th 
letistig sed such a definition of placement in his p 
S and client results. The client was considered 
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= saii ining or educa- 
employed for at least 90 days or if after 90 days a Fi N nat 
tional program. Using this criterion for placemen ee i ferne re 
older counselors and counselors who had pone ee sd thal eote 
significantly more cases than other counselors. It was also tou rl 
selors who had frequent contacts with their client and who saw £ 
be client-employment placed the highest number of cases. rekak 
Levison and Easterling (1974), in a study to predict the n —h 

performance of federal prison inmates, used as a criterion Si S: 
work-release remaining on the job without removal forat least ; me es aich 
They used correlational techniques to determine how well en ae ae ee 
as age, first arrest, and longest prior sentence could predict \ 

rformance, . ot 
p The time-on-the-job criteria are rather straightforward, but en 
always be the most meaningful. Actual ability to do a job may be ati a 
important criterion to apply to some cases. If the job is a simple one, \ Hirte 
definite outcome such as number of machines put together, there i job 
difficulty in making a judgment. On the other hand, for many jobs z rings 
adjustment rating will have to be made by a supervisor. Although this e of 
in the problem of supervisor bias, it is often the best method we ha e 
rating job performance. Anderson and Cox (1972) used supervisors’ ra 
on the Work Adjustment Rating Form (WARF) of 
Youth Corps trainees in order to compa 


scores to actual job performance. It wa 
intelligence test predicted for whites b 
that there was no difference in the 
the Work Adjustment Rating Form. 

One set of ratings, those by instructors in 


Trimmer (1974) to predict the criterion, whi 
those made by supervisors in a 


the author discovered th 


a group of Neighborhoos, 
re the relationship of intelligence - 
s found that a commonly used N ct 
ut not for blacks, in spite of the a . 
average scores of blacks and whites © 


. sed by 
a training setting, was cn 
ch was another set nen 
n employment setting. Among other fin a mai 


Ä ; d by 
ual employment performance as judge 


€ discussed the use of tests. Tests may also $ 
€. The most usual method is to give the a 
rimental condition, and evaluate the chang n 
ein test score. This assumes that a test has bee 


e 0! 
tal Measurements Yearbooks are the best source 
information on tests, 


n 
In an example of the use of tests as a criterion, Gordon, Arvey, Daffron 
and Umberger (1974) studied racial differences in the impact of mathem 
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tics training at a Manpower Development Program. The California 
Achievement Test (Junior High School level) was administered at successive 
six-week intervals over a six-month period. It was found that white students 
profited more from the instruction than black students; this implied that 
racial differences in mathematical competence may be increased by training 


rather than reduced. 


INDIVIDUAL DIFFERENCES 
AND WORK BEHAVIOR 


When we speak of tests, scales, and so forth, we are speaking of techniques 
to measure ways in which one individual differs from another. There are 
some major factors that must be considered when we study vocational or 
Work behavior because they influence differences in performance on many 
of the measures we use. The difficulty of generalizing results from one 
applicant or client group to another is compounded if the groups differ in 
Age, sex, social class, race, or if they have mental or physical handicaps. In 
addition, there are minor factors that produce variations in some training 
and work situations. Discovering what these factors are could be one of the 
80als of your personal research program. We briefly discuss the major fac- 
tors and then indicate several of the minor factors. For additional informa- 
tion on the influence of individual differences, see Tyler (1965). 
Differences in age may influence vocational values, vocational matur- 
Ti Willingness to learn new material, and the ability to pertorm on varpus 
Inds of tests, We would expect, for example, that tests requiring the indi- 
vidual to work fast would give lower scores to older individuals. In one N 
Wolving age, Bjorkquist and Finch (1970) used 44 graduates of two Man 
a Development Training Programs to study personal characteristics that 
at We the client’s willingness to move- 
Ba ich 
no will move to accept pe 
Š Mplication we are concerned with 
age may not predict as well for a grou 


Younger. o 
Many studies are now being done on women, some a t en 
'Bnificant differences between performance of men 2 BR - 
"Ove that no such performance differences exist. It does see 


stablished e norms on certain measures, such 
li vi separate norms ON | 
aS the shed, however, that sepa ; i rn : 


i GAT differences ar 

ex B, are needed. When 

then ea whether these are basic differences that depend on peura 
O sexes or are simply the result of cultural experience and training. 
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Shepard and Hess (1975) investigated the different attitudes ee 
men have toward whether or not an occupation is male or fema a ats 
of reactions showed that both sexes were willing to let women Rn En, 
occupations, but that females were more willing than males to he 
hold and child-caring tasks performed by both sexes, ss ase HOES I 
A third major influence is social class or socioeconomic sare he 
would seem that there are times when Americans would like to nt lal 
class differences, yet we consistently find that people from differen en. 
classes behave differently and have different expectations (Tyler, em 
Kunce (1970) looked at the relationship of welfare status and dee 
ployment outcomes following prevocational programs for aoe y E azel: 
young adults. About three-quarters of the clients who were neither at 
fare nor from the lower SES were successful. About half of the clients i 
were either on welfare or from the lower SES were rehabilitated, and nent 
about one-quarter of the clients who were both on welfare ana aie 
lower SES were successful, Kunce suggests the need to develop si 
strategies for working with highly dependent clients on vocational prob en 4 
Some of the social class influences needing further study in relation 4 
work and employment are attitudes toward society, attitudes toward delay 
gratification, family patterns, and language differences. leat 
Race factors have been studied in a number of ways, and it is now c = 
that race affects test performance, particularly on aptitude and ei Í 
tests. There is research to show that it also affects performance on persone 


ity tests, and there are additional findings that perhaps counselor-eli 
interactions are influenced by race. 


In the case of handicaps, we hav 


ne 
e already pointed out that they intl 
f many employers. 


a better job of ap 
self-esteem and motivation 
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workers isti i i f 
i ea bi unrealistic expectations. Only four of the prostitutes completed 
aining and entered conventional e f fi 
mployment. Of the former i 
workers, all were successful. — 


TOPICS AND AR 
EAS 
OF CONCERN 


Ti j 
pon fatatlonalfoccupationa literature has certain topics that are at present 
bulalo rer a areas. This means not only that they are important topics, 
ti ter iden Eens has the advantage of a body of literature to draw 
not kae Sy and techniques. On the other hand, the counselor should 
the Sally ane in research on topics not mentioned here since he or she is 
setting; The Er ho really knows what will be most useful in a particular 
attention and owing section indicates some of the present areas receiving 
and some of the questions that might be appropriately asked. 


Work Values 
What 
5 : 
spects of work are valuable to a person and do these aspects relate to 
ional decision-points? 


ho : 
These ndlvidual handles the choices at occupati 
Purposes a differ from interests in the way they are used for research 
attached : hen we speak of values, we speak of characteristics that may be 
"esponsibilit, number of occupations, such as job security, prestige, salary, 
satisfactions 4 These usually refer to the kind of psychological reward or 
examined na individual wants to get from work. Work values might be 
Xamples itt items with which the subject is asked to agree or disagree. 
More import : (1) People have a right to expect their work to be fun. (2) It is 
ant for a job to offer opportunity than security. (3) To me, work 


Binas 
Othin RR 
the More than a way to make a living. 
Vues could be investigated in terms of the topics that have already 
iscussed—such as “What are some of the individual differences on 
older 


ri 
va H A : a 
lues, that is, do blacks differ from whites, women from men, 
f work values on the deci- 


rker 
i S . uf 
Sons th from younger?” “What is the influence © i 
Oute, 2t One makes?” “In counseling, do work values influence counseling 
t outcome?” One can take 


Comer 
er } 
al Do work values influence placemen 


Most 

a f . . 

to stud NY one of the topics discussed in the previou r 

introdu. ag The same will be true for most of the other topics we will 
Ce here 


s sections and use them 
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Vocational Identity 


How one’s parents reacted to work (family role models) has been cited by 
many authors as an important element in the development of a person's 
work behavior. We already know that work role models provided by mem- 
bers of the family are not only a source of identification for a person, but 
help the individual formulate his or her own feelings about the world of 
work. It would seem to be important to explore some of the effects that lower 


socioeconomic role models have on the development of work habits and 
behavior. 


Expectations of Work 


The above topics lead to the consideration of the problem of what clients’ 
expectations are of work; that is, what is a definition of good work for a 
person, and just what does the individual want to get out of it. Some work is 
already being done in this area, and one study at least has shown that it 
Important to make a distinction between individuals’ aspirations and their 
expectations. Thomas (1976) studied 118 low socioeconomic status black 
and white male high school students and found that students were able, 
given the opportunity, to distinguish between their aspirations and expecta- 
tions. When the choices were broken down into those two categories, lower 


SES blacks were not significantly more unrealistic than whites in their occu" 
pational expectations, 


Job Satisfaction 


More follow-up must be d . 
one with i been 
placed to find out wh the clients once they have actually 


such questions as: D 
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this series of choices that then determines the eventual pattern the 
individual’s career will take. Westbrook and Cunningham (1970) point out 
two uses for vocational maturity measures: first, to assess clients’ readiness 
to make various educational/vocational decisions; second, to identify at an 
early point the clients with low vocational maturity, thus allowing the coun- 
selor to provide special guidance. 


Techniques of Counseling 


Are the counseling methods developed on highly motivated, intelligent 
clients really applicable to most agency clients? On this topic we need to do 
More research on client reactions to counseling methods. This should give 
Us an opportunity to discover some of the factors that result in attitude 
changes in clients, particularly those relating to disadvantaged and hard-to- 


place clients, 


Changing of Attitudes 


More studies are needed on techniques of changing clients’ attitudes toward 
Self and toward work. Tiffany, Cowan, and Tiffany (1970) show that we can 
reinforce appropriate attitudes that carry over into work behavior or 
eCision-making. Other work (Rosenthal and Jacobson, 1968) opens the 
Possibility that we might most effectively influence clients’ attitudes by in- 
Uencing the attitudes of those supervisors and teachers who have primary 


Contact with them. 


Cognitive Style 


Finally, we may wish to investigate the ways in which clients heres or 
view what they see. What are their expectations of people and events? Do 


SY approach situations with ready-made prejudices to which they make 


reali ; i sult of 
trae Conform (e.g., seeing occupational success as being the res 


uence)? 

We al onse style. 
r $ so need to look at resp np 
lective Does the client feel that what happens to him or her is Hand 
gu ternally controlled? Work by Tiffany, Cowan, and iny A ke 
N © that this is important in a client's search for work and how 


s 
Onds to being unemployed. 


Is the person impulsive or 


338 APPLICATIONS IN FIELD SETTINGS 


CONCLUSION 


m re IS 

For counselors in an employment or vocational counseling ae 
not much published research to help with decisions. ir 7 citer TE- 
other settings such as colleges and rehabilitation centers have oo ae 
search base from which to deal with their clients. At this rs aay 
sure of the ways in which employment or vocational agency n to tel? 
differ from clients in other settings. As a result, although ans zn apply 
questions have been developed in other settings, these findings ap ane 
when vocational counselors attempt to use them in their own ase to have 

This means that for employment and vocational counselors Be 
information applicable to their clients, they will need to do some re me 
on their own. Rather than having the study grow out of theory, as raph grow 
many published research papers, most of their research designs WI licable 
out of a more immediate need for answers and the results will be app 
to the specific setting in which they are working. 


i . ; sin this 
Although we have been using published research for example anyone 
chapter, we do this because many of these designs will be usetul to e 


working in an agency setting. This is not meant to imply that we 
research only if the results are so broad th 


i d a$ 
at they can be generalized an 
such published. In fact, 


: ing loca 
it is this very factor that argues for doing ©. 


to a wide 
research. Published material, by its very nature, needs to apply i 
population. Local research 


if 
can dwell on problems that may be very ee 
cally applicable to a limited group of people or may shed light on a at 
of interest because of some specific local conditions. All of this, a tests 
Suggests that some of the most important information to be used with €! 
will be information generated in one’s own specific setting. 
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CHAPTER 12 
Intervention and Evaluation: 
Two Sides of the 

Same Community Coin 


Steven J. Danish and Kevin R. Conter 


Working in the community—such as in correctional settings, youth service 
agencies, and in consultation and education programs of community mental 
health centers—is a recent development for counselors. Inmany ways coun- 
Selors are in foreign territory when they work in these settings; the roles they 
are often required to play make their task even more unfamiliar and perhaps 
More difficult. The professional community counselor is increasingly less 
involved in direct service activities (where the counselor counsels directly) 
and More concerned with providing indirect services such as program plan- 
ning, implementation and evaluation, consultation, training, supervision of 
other workers, and administration. The delivery of these indirect services in 
Community settings will be the responsibility of the community counselor of 
the future (Danish, 1974, 1977; Lewis and Lewis, 1977). 

Although it is beyond the scope of this chapter to detail the develop- 
Ments and rationale that precipitated this change in focus, a brief discussion 
Seems appropriate. The delivery of human services is rapidly becoming 
decentralized. For example, college and university counseling services are 
emphasizing outreach programs (Warnath, 1973); services are being deli- 
Vered through a variety of other agencies as the number of individuals in 
state hospitals decreases (Bloom, 1973); and the criminal justice system Is 

Eveloping more alternatives to incarceration (Brodsky, 1972). In addition to 
€ traditional delivery of human services geared to remedial efforts, services 
€signed for prevention and enhancement are now increasing (Cowen, 


1979. 
973; Danish, 1977). 
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Despite the growing number of counselors being produced in nae 
graduate programs, there is little demand for them in pen 
settings—even though the need for service is acute. Unfortunately, as CO! A 
selors obtain higher degrees they become too expensive for er 
agencies to hire as direct service providers. The need for less expens! : 
personnel to deliver services has led to the stepped up use of human wid 
personnel. These personnel may have no degree, an A.A. degree, or a on 
degree but certainly cannot be considered counselors under APA or AP i6 
criteria. In addition to the augmented use of less educated personnel ke 
deliver services, new types of services have been developed to meet ex 
needs within the community. The development of support groups (cf. ap 
lan, 1976) and teaching-oriented counseling services (Gordon, 1970; Guer 
ney, 1977) are examples of these new services, but 

Opportunities for indirect service roles are available for counselors, D 
most counselors are still primarily trained to provide one-to-one ounsa ME 
services, Skills such as program planning, implementation, and mance 
are not part of the specific training offered to most counselors, despite i i 
fact these topics may be covered in graduate programs. Nor are cou a 
given training in understanding the unique needs of the community and ! A 
social service system. All too often it is assumed that the counseling me 
prise will transfer from setting to setting unaltered. Therefore, counselors af 


: A í in 
often unprepared to function effectively as the indirect service providers 
community setting. 


For example, across s 
where guard 


ors may have the primary responsibility 
valuating the programs. Unfor at 
© poorly prepared for such roles. They are n 2 
ity’s needs to know what services a! 


e 
Programs, or evaluate the program's effectiveness once th 
needs have been determined, 
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RESEARCH VERSUS 
EVALUATION IN 
THE COMMUNITY 


As noted in Chapter 1, much of the counseling research has been less than 
valuable for community settings. A major reason for its failure to be applica- 
ble is the emphasis on experimental research methods that impose labora- 
tory research designs on the naturalistic setting in an attempt to achieve 
Maximum quantifiability and experimental control. Its basic purpose is to 
uncover causal relationships between variables. Although applying proven 
aboratory research procedures to look for such causal relationships may be 
appropriate in some research, moving into the community with these 
Methods presents problems not found in an evaluation research model. 

Evaluation research differs from experimental research both in terms of 
Purpose and procedure. As already mentioned, the general purpose of ex- 
perimental research is to generate knowledge concerning the causal rela- 
tionships between variables. On the other hand, the purpose of evaluation 
research is to describe each step of the intervention and to assess both the 
impact of each intervention step and the total intervention program. The 
value of a step-by-step assessment is that the counselor can change any step 
within the intervention process that is not fulfilling its prescribed goal. This 
Process recognizes that the final result of an intervention is the summed 
Impact of each step of the intervention and the interaction between these 
steps. Evaluation, then, is a dynamic process in which the counselor 
Monitors each step of the intervention. Evaluation becomes a part of the 
Intervention program development, not a process applied after its develop- 
Ment. 


The shortcomings of experiment 


al research methods become apparent 


when they are applied to programmatic interventions. The trend is to label 
the intervention program the independent variable and the behavior of the 
target group the dependent variable and hope that the intended changes in 
the target group’s behavior do occur and then attribute these changes to the 
Program. For example, Mannino and Shore (1975) reviewed the effects of 35 
Consultation outcome studies conducted between 1958 and 1972. The basic 
question was “Does consultation work?” Although the authors conclude 
that in 69 percent of the studies reviewed positive changes were demon- 


trated on the consultee, client, or system level, or some combination of 
these is left knowing little about what the process 


se) RE: r 
Consultation is and its value, and 
€ findings. In this case consultation has 


Variable, Any change in the target group’s behavior is attributed to the 
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consultation. No effort was made to detail what the process of or cas 
was and why it was effective or ineffective. Consultation is nota uni a 
sional process and even defining it as education-oriented, Ina e 
group-centered does not help the counselor know how to implemen sae 
what parts are effective and therefore necessary to include. The gonne = 
at a loss as to whether instituting a reported successful program nn ‘he 
useful for a particular situation. Even if consultation is found to be usefu re 
counselor still may have little knowledge about how to operationalize | 
program concretely, what danger signals to look for, or what the ae 
components of the program are. Faced with this kind of situation, it is li ` 
wonder that research in the community is generally considered an imposed, 
additional task that is time consuming, frustrating, and perhaps only mini- 
mally informative. Pe 

The distinction between evaluation and experimental research is simI- 
lar to the delineation between formative and summative evaluation made by 
Scriven (1967). As he conceptualized the difference, formative evaluation 
focuses on short-range (proximal) goals, which may be conceptualized ES 
the series of actions utilized in achieving more long-range (distal) goals. The 
result is that programs are evaluated to determine what works. Continuen 
monitoring is carried on, and modification, alterations, or reinforcement © 
the program are introduced when necessary. Outcome studies fumma 
evaluation), to determine whether distal goals have been achieved, are only 
conducted fotlowing extensive formative evaluations. 


A MODEL OF COMMUNITY 
INTERVENTION AND EVALUATION 


During the first sections of this ch 
has been identified and distin 
research methods and evalua 


apter, an alternative role for the counselor 
Ctions have been drawn between experimenta 
' tion methods as they apply to the community: 
Intervention and research in the community often require a significant IN 
vestment of time and effort both for the counselor involved and the con” 
munity participants. What follows is an outline for the counselor to use al 
the beginning of an intervention-evaluation project within the community- It 


odel presents a sequence of activities: i 
: ed. The activities have been divided int© 
three major stages—planning and identification, implementation, an 
dissemination—as well as into a series of smaller procedural steps. An effec- 
tive counselor may need to adapt the order of these activities to meet 4 
particular situation or to accommodate individual styles. 


INTERVENTION AND EVALUATION 347 


Planning and Identification Stage 


The first step in any community intervention-evaluation program requires 
making contact with the community. Entrance may be gained by serving as 
or being asked to be a consultant, by volunteering one’s services, or by 
seeking to alter an already established relationship within a community to 
meet a perceived community need. Using consultation as an example, al- 
though the skills, knowledge, and attitudes necessary for effective consulta- 
tion have been described elsewhere (Caplan, 1964, 1970), a brief discussion 
of some of the preentry issues a consultant may face seems fruitful. Cherniss 
(1976) defines several issues that he considers unavoidable and that must be 
examined before any planning begins. They are: (a) Should one do consulta- 
tion in this situation? (b) Whose interests is the consultation serving? and (c) 
What is the primary focus of the consultation? To answer these questions 
fully a needs assessment, which is discussed below, may be necessary. The 
Issue of entry into the community is discussed here to sensitize the reader to 
the fact that wanting to work or conduct research in acommunity will not in 
itself suffice as a reason for community consultation. Ethical and value 
Questions as well as cost-benefit analyses issues abound. 

Following entrance into the community and the clarification that the 
Counselor’s needs and interests are consistent with those of the community, 
a community needs assessment should be conducted. Needs assessments 
involve the development of instruments and a technology to determine the 
Needs of a particular community. By a community we are referring to the 
large number of formal and informal organizations and agencies that exist, 
including the school system, human service agencies, business and profes- 
Sional groups, youth organizations, religious organizations, neighborhood 
8roups, and the like. In addition to actual citizen participation in the deter- 
Mination of needs (Bell and Warheit, 1975; Weiss, 1975), epidemiologic 
Assessments (Roen, 1971; Schwab, Warheit, and Fennell, rl or census 

nd social statistical data (Stewart and Poaster, 1975; en e, Rosen, 
oldsmith, and Shambaugh, 1975) can be used. When the information is 
8athered, decisions can be made about what needs exist, what EN 
services the community is aware of, and what services the members of ni 
munity feel they need and what investment in time, energy, and tunas 
AT i The examination ot the services 

eY are willing to expend on these services. 1") j ds f ice 
Available in conjunction with the determination of the needs for services 


Provid i d 
e€ an estimate of community nee s. ; ' 
For exampl : if a counselor was concerned about the extent of human 
Sas a gs eds assessment could be conducted. 


Seryj p 
Vices being offered to the aged, a ne 
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By examining census and social statistical data, the counselor could deter- 
mine the percentage of the population who qualify as elderly. The counselor 
could then survey existing human service agencies to assess the type and 
extent of geriatric services offered. Matching this information with an 
epidemiological survey delineating the medical, psychological, and human 
service needs of the elderly, the counselor would then be able to determine 
what additional services could be incorporated into the community, what 
existing services could be altered to meet unmet needs, or what services 
could be eliminated to avoid unnecessary duplication and expenditures. 
As part of a needs assessment of the community the counselor may 
institute evaluation efforts to determine whether the agencies are delivering 
the services they are committed to. The counselor must be aware of why the 
evaluation is being conducted. Evaluation may be thought of ideally as the 
means to determine if a program or agency is meeting its objectives and 
should be continued, expanded, altered, or changed. However, as Weiss 
(1972) notes, there are other reasons for an agency to undertake an evalua- 
tion: (a) the decision-makers may be trying to postpone a decision by under- 
taking a time-consuming evaluation; (b) administrators or decision-makers 
may be ducking the responsibility of decision-making by seeking an ‘“objec- 
tive evaluation” and thus avoiding taking sides between opposing factions; 
o establish good public relations and 
hough superficial, evaluation; and (d) 
y to fulfill grant requirements, in which 
iority relative to problems of staffing, 
- A decision by an agency to conduct a 


ag the results and impact on the com 
uation. If the assessment has indicated that 
public is unaware of them, the counselor may 
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television advertisements for “mental health” tend to be sterile and formal, 
increasing people's reluctance to use the services. If the media can be used 
SO effectively to sell products, people, and ideas, why can’t human services 
be sold? 

If the services are inadequate but the existing agencies do not recog- 
nize the inadequacies, the counselor may want to help the 
Eitizen-consumer advocate for increased programs. One way to advocate 
for improved services is to organize the affected group and lobby for the 
needed services (Alinsky, 1971). Another method might be to contact al- 
ready existing advocacy groups to gain their assistance. For example, the 
Massachusetts Advocacy Center (1971; Suffer the Children, 1972) has 
helped pregnant teenagers and parents of mentally retarded children gain 
the services they need and are entitled to by law. Advocacy as an interven- 
tion has been generally overlooked by counselors. Nonetheless, the process 
Of advocacy training and evaluation is certainly within the domain of the 
Counselor's role. 

If it is determined by the assess 
Services and the community that an 
ram) is appropriate, the counselor ma 
Ment and evaluation of a new program. T 
affect the nature of the intervention proposed 
Implemented. 


ment and agreed by both the existing 
additional service (intervention prog- 
y then wish to focus on the develop- 
hus, the results of assessment will 
and the manner in which it is 


Implementation Stage 
If it is concluded that an intervention program is desirable, the first step is to 
Ormulate the intervention goals. Two sets of goals are ee en 
OnB-range (distal) goals and short-range (proximal) goals. l ne Jeo relate 

the goals the community has identified; the latter are subgoa ari pian 
foals designed to implement the long-range or distal Ben at ee 

un nselor should become ee ek i ha. a form 
Unity goals. Without the counselor’s input the goals may 


th j 
at they are unattainable, unmeasurable, or both 


i identif insofar 
i munity to identify the goals, inso 
ee a den piaia s 962). This goal description should 


S Possible į > Mager, 
e, in behavioral terms (Mager, 2 a ee 

ns Present learly as possible, the status of the community s prog 
toward achie a “nd 4 al : d the importance of the goal from the perspec- 
Chieving the goal an x op ibed, the 
= comm nity When the goal has been identne pear 

orc d ine who and what groups ne i 

Een Geet ese groups need in order to 


Counsel 
i th 
d what skills, knowledge, and attitudes 


With, an 
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achieve the distal goal. These en skills, knowledges, and attitudes 
me the proximal goals. . 

a e ke len: le colleague (Danish, Conter and T 
berg, 1976) were recently involved in developing a proposal to bint wen 
in crisis identification. This proposal was based on a community s ‘ : a 
to develop a Victim-Witness Advocate Program (V-WA). This Bean in 
designed to provide effective on-site police management of crises ? 
allow a smooth transition of a victim or witness of a crime over to the = i 
program’s professional staff of counselors. The development of this cm e 
was in keeping with the overall objective of increasing the public's co i 
dence in the criminal justice system. To attain this overall objective, th 
following goals were identified by the community: 


J: To determine and classify the number and types of m 
program-related needs of all victims and witnesses that come 
the attention of the V-WA Program. 

2. 


To provide the services necessary to address the needs of 100 i 

percent of the victims and witnesses that desire assistance fron 

the V-WA Program, to the degree that: ME 

a. The V-WA Program or another referral agency has sufficien 
resources to meet the needs. 

The V-WA Program is the appropriate agency in the county 

to provide or refer the service. 


b. 


3. To increase the abilit 


y of 80 duly commissioned officers to 
identify victims and 


witnesses in need of crisis assistance. 


4. To increase the number 


á icers 
of referrals by law enforcement offic 
of crisis victims 


and witnesses to crisis intervention resource 


. ffi 5 
5. To increase the number of referrals by law enforcement officer 
of victims and witnesses in need of social services to social 
service resources, 
$ aa itness 
6. To involve at least 100 volunteers in providing victim-witnes 
assistance in the project. 
7. 


To increase the apparent willin: 


ime 
gness of the public to report crim 
in the county by 10 percent 


within a three-year period. 
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8. To increase the willingness of the public to assist in the 
prosecution function by 20 percent within three years by 
providing testimony, evidence, or information. 


__ In order to meet these goals, especially the third and fourth goals, law 
enforcement officers must be capable of diagnosing the problems and sub- 
sequently referring the victims and witnesses to the appropriate advocate 
Program specialist. If the officers are unable to detect a victim-witness prob- 
em and are unaware of how to use the V-WA Program, then the program 
l be unsuccessful in attaining most of the interrelated goals. Therefore, 
the purpose of the training program was to sensitize police officers to the 
Various problems that victims and witnesses encounter resulting from crime, 
to inform the officers on how to correctly diagnose a victim or witness 
Problem, and to educate the police on how the V-WA Program works. 
ea The authors were involved in developing subgoals or proximal goals to 

elp this particular department to achieve the third and fourth distal goals. 


The f : 
he following process goals were developed. 


a. To identify the causes of crises 
b. To identify citizens who are in crisis 


€ To identify the officers’ reactions to crises and the effect crises 
have on their behavior 
d. To develop a repertoire of behaviors for crisis situations 


ei To recognize the consequences of their various responses on the 


behavior of citizens in crisis 
s and be able to determine 


f. To assess the needs of citizens in crisi term 
what kinds of intervention strategies are necessary to facilitate 
referral 

8. To identify referral services in the proposed area 

h To develop an understanding of cultural and ethnic minorities 


imal goals, the next task 


e distal and prox | 
First, it is necessary to 


Following the delineation of th i 
proximal goal. 


S to fis E 
Clarify three aspects of each 
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i istal goals 
ascertain that each proximal goal relates to one or more of cai ya 
and whether the proximal goals need to be E ay er. 
quence. This is essentially an indication of a. shin ne ans 
ing that the proximal goals are related to the distal goa n EnS eisen. 
of the proximal goals was to have trainees learn how to diffuse en zoal: 
it would be an inappropriate proximal goal given the identifie S a 
Clearly, however, this goal is appropriate in other situations. a ak 
be determined whether each proximal goal is measurable a a en 
within certain time and money constraints. For instance, in in femal ai 
above, although the agency might agree that all the proximal Br En e 
important, if they felt that these goals would need to be achieve He ae 
maximum of 30 hours of training and $5000 in expenses, this migh ns 
the nature of the training developed. Third, one must clarify —— See 
attainment involves the learning of a skill or the acquisition of a know. nay 
or a change in attitude or all of the above. For example, in the ne: 
goals listed above, goals b, c, and d require skill learning; a, e, and 8 ‘onl f 
acquiring new knowledge; and h involves acquiring new attitudes. 
involves both learning new skills and knowledge. deile 

After the determination of distal and proximal goals the un te 
Principles of these goals should be specified. This process, cal n is 
rationale, includes: why the proximal goal is important, how it contrib S 
to the eventual attainment of the distal goal, and whether proximal ae 
need to be attained in some specific order and why. Essentially Hd 
rationales are developed; one is theoretical, includes the points just a 
tioned, and is for the program designer and the community, while the se 
ond is presented to the trainee and acts as a Motivational force to esis 
optimal participation. This second rationale, in addition to containing Je 
formation about the relationship of the proximal and distal goals as ae 
scribed above, would also Contain information about the process of learning 


: : ó ae 
the skills, knowledge, and/or attitudes necessary for proximal goal attai 
ment. 


% j nt 
pment of the rationales, a level of attainme 


ification of 
mal and distal goals is specified. The specification a 
this level enables the co the participant, and the counselor to kno 


i + i t. 
Participants can build more proficient attainmen 


; ‘ 
For instance, in a Program to teach communication skills to Cub ScoU 
leaders (Conter, 1977), one of th 


© distal goals was that den leaders display á 
set of interpersonal skills that would facilitate pro-social behavior among th 
den participants. The ac nying proximal goals were: identifying a^ 
reflecting the boys’ feel; Cognizing their own feelings and expressing 


compa 
ngs; re: 
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them in a nonjudgmental way; reinforcing appropriate behavior; specifying 
the acceptable limits for the boys’ behavior; and clearly structuring the 
environment, both physically and verbally, so that the appropriate behavior 
was facilitated. An example of level of attainment for one of the proximal 
goals—identifying and reflecting the boys’ feelings—was: being able to lis- 
ten to a series of audio-taped statements made by boys and correctly iden- 
tifying their expressed feelings, and using these feelings in a brief statement 
demonstrating the leader’s recognition of the feelings and their source. 

When a level of attainment is specified, the procedures used to assist 
the participants to attain each proximal goal can be determined. The proce- 
dures followed can be designed to facilitate evaluation as an ongoing com- 
Ponent. For example, a format based on general instructional principles 
(Gage, 1963; Gagne, 1970) can be followed. The format includes: (a) iden- 
tification of explicit behavioral objectives; (b) practice or application of 
skills to be learned; (c) self learning by group discussions; (d) rationale for 
learning (understanding of importance of certain skills); (e) sequential pre- 
sentation (learning concept A before concept B); (f) active trainee participa- 
tion; (g) the use of modeling; and (h) the use of immediate feedback con- 
cerning the appropriateness of trainee responses. l 

This format seems especially appropriate tor teaching skills. Having 
Knowledge about the skills is not enough. Effective learning involves acquir- 
INg a conceptual understanding of the components of the skill (knowledge); 
Viewing others demonstrate the various aspects of the skill (modeling); and 
AN opportunity to use the skill (practice) (Danish and D’Augelli, 1976). 

In using such a model, one’s evaluation time could be consumed 
Evaluating the relative effectiveness and efficiency of various learning pro- 
Cedures for attaining proximal goals. One could, for instance, assess 
Whether each component of the proximal goal is necessary, how the com- 
Ponent contributes to the proximal goal, which components are most impor- 
‘ant and which can be left out, what is the most effective way to present each 
“omponent, and so forth. Essentially, these are “efficiency questions be- 
Cause jn the long run they effect the cost-benefit analysis of the intervention. 

Owever, these cost-benefit questions are secondary. The major questions 
Are: does ihe lesmingak imal goals relate to learning the distal goal, 
5 arning of the proxir 


D if e dista ed, i ity “better off’ as a rest lt? If 
th i goa is learn s the community \ 
j se i : je 2 (= ly, then the next question 
JOr questions can be answer 


d affirmative 
an we more efficiently 


i Is?” 
achieve these 80a . En 
g „arlier it was noted that the counselor needs to be involved in identity 
the distal goals so they are attaina 


ble and measurable. If not, it may be 
ach; sible to determine whether the panne of a = sono 
leved, A d distal goals, the measurement O = 

- As one moves towar 15 


ish 
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comes more general, less sophisticated, and more difficult. Tests and other 
obtrusive measurements become less useful, and unobtrusive measures be- 
come more predominant. For example, in the crisis identification proposal 
described above, one distal goal related to the number of referrals of victims 
and witnesses to social service agencies. Using unobtrusive measures, Com- 
parison could be made of police and social service agency records three 
months prior to beginning a program for training officers in crisis identifica- 
tion and referral, immediately following the conclusion of training, and 
again at a later period to account for a delayed training effect. To interview 
or test citizen-victims and witnesses during their crises would be of limited 
value and might be unethical and obtrusive. 


Dissemination Stage 


The general procedure for reporting results of a research project is to write 
the results in the form of an article for journal publication. Unfortunately, 
reports of evaluations of community interventions tend to be written as final 
reports for the funding agency. Either way, such a procedure directs the flow 
of information to a professional audience. Although this is an established 
procedure, evaluators of community intervention must ask for whom this 
evaluation has been conducted and who is to benefit from the information. 
Limiting reports of the community intervention to professional audiences 
negates the real purpose of the intervention—community change. Because 
community agencies sponsoring the program may also require and benefit 
from the report, the counselor should make an effort to write the report in 
language that is understandable, clearly spells out the meaning of the results, 
and offers guidelines for decisions that might follow from such a report. In 
other words, the community as a whole should be viewed as the ultimate 
consumer and as such has a right to demand that reports be written in 
language understandable and useful to them. 

It is insufficient for the counselor to present the information and then 


view the task as being completed. The counselor must facilitate the use Of 
the information by others for co 


is not just written in langua 
implications of how the inf: 
The counselor has to cons 
needs the community ident 
tion in itself and as such th 
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The steps would be small, objective, measurable ones, specifying change in 
terms of behaviors and delineating how the community would know when 
the changes have been achieved. 

If the evaluation is to be an essential part of the community’s growth 
and development, it must be disseminated in a manner that will have max- 
imum impact. Regardless of how well done an evaluation is or its ‘“objec- 
tive” results, if it does not promote change in its intended program, system, 
or community, then the evaluation must be regarded as a failure. 

For instance, if as a result of a needs assessment with the aged it was 
determined that there were increasing numbers of complaints from the el- 
derly regarding their transportation difficulties, the following 
intervention—evaluation-dissemination process might occur. The elderly are 
Usually quite dependent on public transportation yet taxis are often too 
expensive and buses require a continuous state of mental and physical 
alertness that some elderly may nat be able to maintain. A counselor might 
have developed an intervention with the bus company like reserving special 
Sections for the elderly near the drivers, having the driver call out street 
Names, and reducing the bus rates for the elderly during nonpeak hours. A 
Comparison of baseline versus post-intervention data should demonstrate a 
Significant increase in the number of riders and rider satisfaction and a 
decrease in the number of elderly riders exiting on the wrong street. 

Although dissemination to professional audiences is important, in 
Order to increase the usefulness and potential impact of the intervention and 
''S results a more active process is necessary. The counselor must “sell” the 
findings to the community. A cost analysis of the pangram mih be ui 
Cucted to determine if the increased number ot riders an = met 
Mage the bus company gains as a result of the program negates the potentia 
increased operating costs so that the bus company can ae the ile 
Sram, The counselor may need to help the bus company develop a public 
relations Campaign to sell the program and its new image. 


CONCLUSION 
n-evaluation program as we have de 


i = f ide the 

SCribeq the counselor will have to solicit help from people a" 
sS À á J 
mi service and mental health establishments. Pi ihn SERTE 
< Teal P ç munity and Its 
working k ledge of the com 5 

r nowledge ndut 
“Sources, It monomer aie fora counselor to use a at to en 
'Ntervention and evaluation study. One needs to = Is this beste = 
‚for, or with the community?” Unless the counselor has a com 


To , 
follow through on an interventio 
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the welfare of the community and intends to follow through on the program 
to ensure its usefulness, serious questions must be raised about the 
counselor's purpose. Presentation of results and findings to professional 
audiences does not fulfill that commitment. Dissemination, then, is an active 
process and becomes the implementation of the first stage of the model—the 
planning and identification process. 
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LEGAL AND ETHICAL ASPECTS 


CHAPTER 13 


Legal and 
Ethical Concerns 
In Research 


Donald N. Bersoff 


Experience should teach us to be most on our guard to protect liberty when 
ae Government's purposes are beneficent. ... The greatest dangers to 
iberty Jurk in insidious encroachment by men of zeal, well-meaning but 


Without u K 2 
nderstanding. 
$ —Justice Brandeis dissenting in 


Olmstead v. United States (1928) 


and Brim (1965) stated that, “It requires 
and a spate of restrictive legisla- 
s—even for the most legiti- 
sitive appreciation for both 


a he a decade ago Reubhausen 
ti assandra to predict lawsuits by parents, 
ion, if those who administer . . . tests in school 
Mate of scientific purposes—do not show a sensit q i 
Individual and group claims to a private personality” (p. 1194). If there is 
ANY error to that assertion, it is merely that the authors underestimated the 
eadth of concern that has emerged with regard to privacy in all institu- 
tional facilities and governmental agencies, not only in educational settings. 
In all Other respects, there is NO doubt as to the accuracy of the prediction. 


This chapter explores precisely how courts and legislative bodies have 
influenced the conduct of research in colleges, schools, mental hospitals, 
"sons, and other institutions where counselors work. To help guide the 
'SCussion, the chapter begins with the presentation of a factual situation 

resulted in a lawsuit against a school system planning to administer 
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f i atment pro- 
personality tests as part of a drug a Ea ar 
E ome er en! Pa a the legal bases on 
endete ch to experimentation with human en 
The Chaple shows how, in the context of a specitic ab ban cae 
employ the legal doctrines explored in the Merriken case ati et 
from the courts to the statute books. The federal government . : pers 
become intensely involved in monitoring biomedical and hams ` m 
search, and a variety of governmental agencies and er a : 
to promulgate regulations and guidelines that now, or soon wi i onde 
vast amount of research. The last part of the chapter deals with t ze ee 
and perhaps unsolvable conflict between the researcher’ s right to i n eleged 
the individual’s right to privacy. To bring together the principles dev ai 
in the first five sections, we offer an analytic framework to aid couns ah 
researchers design studies that meet legal and ethical demands and to am 
counselors evaluate whether they wish to participate in the researc ies 
others. Finally, there is a brief personal note in the nature of a plea for ren 
cooperation between the experimenter and those the experimenter studies 


c LAP d p X terat 
It may be helpful to highlight the Issues raised throughout the chap 
the start. Prime among them are: 


% In what ways does research inv 


atte lese 
ade the private lives of those 
study? 


In the light of this potentia 
accommodate our proced 
demands and legal requir 


| invasion, how must we 


ical 
ures so that we meet both ethica 
ements? 


3: In Particular, wha 
subjects should b 
choice as to their 


; aa i tial 
tare the kinds of information that our poten 


: e 
© given so that they may make an inform 
Participation? 


ited 


ay have a lin 


x 
e me 
rego the research even though ther 
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Je some po i S either participants or society a 
tential benefits to part 
= n 
F p: 5 sa 


Gimmie that the reader will find no cases described in which 
fa bee found ye ceo in tact, very tew cases involving researchers are 
Hike Taw “i a ei ith the exception of Merriken v. Cressman (1973), in 
mer dha ances where courts have become concerned, the dispute in- 

biomedical rather than behavioral research or touched on matters 
security. Most research that counselors engage 


all imal? 
alleged to implicate national 
aving therapeutic intent. Coun- 


in can be ‘ 
ea be appropriately characterized as h 
s are interested in data-gathering to benefit the participant as well as 


i y 

te nis services. Scientists whose basic aim is research are less 

Patticipante i goal, to be interested in the therapeutic benefits to 

Fulthenions thus become more vulnerable to legal claims by subjects. 

hatch de counselors rarely intend to deceive their clients as part of a 
sign, unlike some social psychologists who depend on deception 


to st A 
study particular phenomena. 


This į 
ahun is not to say that counselors W 
ine about possible legal involvement. The invasion of privacy may 


Occur in cionit = 5 h 
Serin in significant and subtle ways, from the gathering of data to its dis- 
eale o And, from an ethical perspective, putative participants may be 

d as objects when left unserved for the sake of populating a control 


Brou A ne 
P. This chapter is, thus, designed to sensitize the counselor planning 
nherent in such an endeavor, 


fesea 
a ! ; 
arch to the ethical and legal problems i 

needs assessment, descriptive 


ether ir; 
research it involves naturalistic observation, 

of the «sing data gleaned from agency files, program evaluation, the study 

effectiveness of several methods of therapeutic intervention, or others 


Of th $ i 2 
© myriad of possible research strategies described in this book. 


ho engage in research should be 


A 

PLAQVERNMENT AGENCY 
S A STUDY 

of Montgomery County, 

led Scientific Resources 

were heavily involved with drugs. 

osen in the January 1974 issue of 


Commissioner 


In 4 
97 
0, a survey ordered by the 
a company cal 


enns : 
ylvania, and conducted by 


feve; 

(I ie that many children in the county 

ivi] Hind aaarty on an article by Diane R : ee 

icial erties for many of the facts presented here but not found in the 

aal Written opinion of the court that decided the case.) Most of the 
imed, possessed some common 


Child 

re 

ch n who used drugs, the study cla se moı 
cent of the identified drug abusers indi- 

at they felt estranged from their families. On the basis of such data 
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ission 

Scientific Resources proposed to the Montgomery County i meas wet 
that they sponsor a drug prevention research and treatmen l ai reed 
was later to be labeled CPI, for the Critical Period of saan 
the county school districts agreed to participate in the program. aion 18 

There were two phases to the study: identification and reme oes ei 
the first phase, questionnaires were to be given to eighth grade pane : a 
their teachers so that certain students, deemed potential drug a ate 
become part of the remediation program. The teachers were enh ened 
tify pupils who most and least fit eight descriptions oes af during 
for example, “This pupil makes unusual or inappropriate respor i - tee 
normal school activity.” The student form was to be somewhat e in io 
First, students would be asked to assess their own behavior, for ne 
state which of the following statements was most like themselves: m awe 
one who will probably be a success in life; (2) One who gets upe self 
faced with a difficult school problem; (3) Someone who has lots e ihe 
confidence; (4) A student who has more problems than other students. e 
next part of the questionnaire they would be asked questions aD 
relationships with their parents and the behavior of their parents, for € Fe 
ple, to indicate whether one or both parents “tell me how much they a 
me” or “make me feel unloved” or “seem to regret that | am growing ee 
spending more time away from home.” Finally, the students would fick in 
from their classmates those who fit certain descriptive statements simila 
kind to the ones given the teachers. 

The second ph 
analyzed all the re 


have significant potenti 


among 
ovide 
the 


anize a joint effort 
sts, and others to pr 


eer 
stated purposes was to use the a 
Qualizer insuring that its members do not stray 


; . in- 
When the program was first developed the school system did not = 
tend to obtain the affirmative consent of the parents for their children = 
participate. The researchers did plan to send a letter home to each paren 
follows: 


Dear Parent: 


This letter is to infor 


m you that, this fall, we 
called “Critical Period 


ram 
g o 
of Intervention” (CPI). 


Pee o; 
are initiating a Drug = is 
The aim of this progran 
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identity children who may be susceptible to drug abuse and to intervene with 
concrete measures to help these children. Diagnostic testing will be part of this 
program and will provide data enabling the prevention program to be specific 
and positive. 

_. . We ask your support and cooperation in this program and assure you of 
the confidentiality of these studies. If you wish to examine or receive further 
information regarding the program, please feel free to contact the principal in 
your school. If you do not wish to participate in this program, please notify your 
principal of this decision. We will assume your cooperation unless otherwise 

notified by you. ... 
Also, as originally proposed, the study contained no provision for student 
Consent. 


Sylvia Merriken, the mother of one of the intended participants in the 


study, who happened to be a therapist in a drug and alcoholic rehabilitation 
Center, complained to the principal of the school where her son was enrol- 
led and to the school board. The American Civil Liberties Union (ACLU) 
then announced it would represent Mrs. Merriken in an attempt to perma- 
Nently enjoin the school from carrying out its plans. The ACLU began by 
iling a complaint in the appropriate federal district court claiming that the 
Program would violate the constitutional rights of both Mrs. Merriken and 
"er son. It quickly obtained a temporary injunction prohibiting the county 
rom implementing its proposal until the litigation was completed. At that 
Point, two of the three schools in Montgomery County decided to discon- 
tinue their participation but the Norristown system, which Mrs. Merriken s 
son attended, persisted, although it honored the temporary injunction. 
When the suit began in earnest the school system offered to change the 
format of their letter so that affirmative written parental consent to partici- 
Pate would be required. In another attempt at comprom'se, the school mod- 
Ned the test so that students who did not want to be included could return 
an uncompleted protocol. But the proposal contained no Br. ~~ 
ent Consent and no data were to be provided whereby students could make 


a ae . 
N informed choice about participating: 


LEGAL UNDERPINNINGS 


iuthough Mrs. Merriken’s lawsuit named school officials as defendants, ie 
Sgal issues Karen TEA litigation have relevance to all public institutiona 
tings in which essere might be conducted. Schools, after all, 1 gov- 
a, Mental agencies like Veterans Administration hospitals, public colleges, 

Vocational rehabilitation offices. They 


are also like mental hospitals and 
Ons where a great deal of power iS delegated to authorities who make 


Pris, 


368 LEGAL AND ETHICAL ASPECTS 


decisions of significant import concerning the lives and well-being of ohe 
It is in these settings that counselors are to be found and in which mucl s 
their research is planned. Furthermore, like much of the research that op 
selors undertake, the CPI study was planned in good faith to bengh bei 
participants. What increases the instructive value of a school-based an pe 
is that the researcher must consider both the legal rights of those who by ae 
have limited capacity to consent—children—as well as the rights of 

participants’ primary caregivers—their parents or guardians. a 

In the context of this chapter, Mrs. Merriken’s complaint helps i un 

nate three important legal principles. First, will courts intervene in inene 
tional affairs or will they respect the discretion of the institution and m 
professional employees? If they do intervene, on what legal bases nn 
they decide to do so? Second, the ACLU was alleging that the plann k 
research was violating certain constitutional rights of the Merrikens; m 
reading of the Constitution could they rely on to block a program the schoo 
claimed was a matter of important public interest? And, third, were there 
other nonconstitutional breaches of a legal duty by the school system? 


Ey E, - presente 
better understand the specific manifestations of these problems as present 


3 i a aà y ; ers 
in Merriken, it will be helpful to first spend some time exploring the answ' 
to the questions raised in more gene 


ral terms. 
Judicial Scrutiny of Institutional Behavior 


Increasingly, courts have carefully reviewed the behavior of officials who 
direct, supervise, and work in public agencies. There was a time, Rue 
when institutional behavior went virtually unexamined. For examp S 
courts—pleading lack of expertise—were wary of interfering in the discre 


. c Baji a 5 
tion of school administrators to control and educate their students. As late 4 
1968 the Supreme Court was reaffirming that understanding: 


Judicial intervention in the o 
raises problems requiring ca 
in our Nation is committed t 


onflicts which arise in sa 
t directly and sharply iMP 
: sas, 1968, p. 104). 
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Operation of a wide variety of agencies. In some instances, psychiatric 
facilities, state schools for the retarded, and prisons have virtually been 
Operated by judicial decree. Private businesses have been ordered to elimi- 
Nate discrimination on the basis of race, sex, or handicap in their employ- 
Ment practices. And, in a decision that should evoke at least a modicum of 
anxiety among public officials (including counselors hired by public agen- 
Cies), the Supreme Court ruled in 1975 that such officials were not abso- 
lutely immune from liability for money damages when, under certain cir- 
Cumstances, they violate the constitutional rights of those for whom they are 
responsible (see Wood v. Strickland, 1975). 


The Right of Privacy 

h Privacy one of those constitutional rights that will be vigilantly protected 
ay the courts? Given recent decisions by the Supreme Court it is very dif- 
hat extent an individual’s claim to a privacy right 


fi : 
cult to tell precisely to w man 
a right, whatever i 


Will be protected, but there is little doubt that such 
Parameters, is now embedded in the Constitution. 

__ Although privacy, as a constitutionally protected right, has been recog- 
nized only in the last dozen years, there were some early intimations that 
there was legal justification for claiming its protection. In 1891, the Supreme 

Ourt declared that “no right is more sacred, or is more carefully guarded by 

"€ Common law, than the right of every individual to the possession and 
Control of his own person, free from all restraint or interference by others, 
Unless by clear and unquestionable authority of law” (Union Pacific Ry. Co. 


v- Botsford in an impassioned dissent to a decision 
Pe a A ea; Justice Brandeis asserted 


hold 
Ing any wiretapping legal (since overru 
f apping legal (sin 1 h oy 
that the framers of the Constitution had conferred to the private citizen, as 
eal ‘ i lone that he called “the most 


alnst the G ial be let a 
c overnment, the right to af: a 
Mprehensive of rights and the right most valued by civilized men.” To 


rotect that right, he continued, “every unjustifiable intrusion by ue wi 
mu ent upon the privacy of the individual, whatever the nn 
Sa be deemed a violation of the Fourth Amendment” (Olmstead v. sipend 

tes, 1998 B : icsenting, p. 480). But, neither Botsford n 
O; , Brandeis, J., dissenting, 


; i ‚as pro- 
stead explicitly recognized that the right to privacy as such was p 


tect 

€d by 4 ee 

Ne Constitution. ; f N 
N 1965, however, the Supreme Court IN Griswold v: pes er 

in epti nd that the sta 
E contra on the grou! ; 
ite right a aig a soon made clear that the right was Bi 
Sie husbands en wives. In Eisenstadt v. Baird (1972) the Suprem 


370 LEGAL AND ETHICAL ASPECTS 


See TEs i he 
Court stated: “If the right of privacy means anything, it ee ie 
individual, married or single, to be free from unwarrant ar peice 
intrusion into matters so fundamentally oe a person as 

to bear or beget a child” (p. 453). . ? 
ar = privacy Fe a constitutional right. But what N mg 
In Griswold, Justice Douglas, who wrote the majority opinion, W on 
the right of privacy in the “penumbras” of a variety ot coig nhe 
amendments, never offered a definition of privacy. That may have anally 
judicious tack to take since there has yet to be published a though 
accepted description of the concept. There have been severa he 1974; 
attempts to define privacy (Beaney, 1966; Bloustein, 1964; an and 
Parker, 1974; Reubhausen and Brim, 1965; Shils, 1966; Westin, 1 we a 
two somewhat overlapping aspects have been identified as N 5 
right. One is the right not to suffer governmental prohibition or iat 
the result of engaging in private activity; the other is to be free Ba ieee 
mental gathering, storage, and dissemination of private information that 
Dorsen, Bender, and Neuborne, 1976). However, it is probably Nt tto 
“the right of privacy is largely a subjective, incorporeal right, “ol a 
identify and incapable of measurement” (Reubhausen and Brim, 1 aan 
1186). But, whatever else it might mean, there is agreement that at art 
component of privacy is the right to determine when and in what ma 
personal information will be communicated to others. 


-hoose 
The essence of privacy is . . . the freedom of the individual to pick an cho he 
for himself the time and circumstances under which, and most important Tre 
extent to which, his attitudes, beliefs, behavior and opinions are to be ’ laim 
with or withheld from others. The right of privacy is, therefore, a positive © 


scial kin 
to a status of personal dignity-a claim for freedom .. . of a very spec'a 
(Reubhausen and Brim, 1965, pp. 1189-1190). 


Alternatively, 


jo 
= the acquist!” i 
The decisive element. . . that defines [a breach of privacy]... i$ the 20 ye 
or transmission of information without the voluntary consent or Inite 


4 ie 6, PF 
those whose actions and words generate the information (Shils, 19° 
282-283). 


The judiciary—true behaviorists—never at 
were content to indicate wh 


sonar be 
tempted to define priv@% ge 
(1973), the case establishin 


al 

E 

at activities comprised its scope. In Roe nee cout 
8 a Woman’s right to abortion, the Supren 
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acknowledged that the guarantee of personal privacy extended to conduct 
related to marriage, procreation, contraception, family relationships, 
childrearing, and education. It is not yet clear whether, or to what extent, the 
constitutional right of privacy extends to other areas. 

But even in the areas just mentioned, the privacy rights guaranteed by 
the Constitution are granted to adults. A great deal of research that coun- 
selors do, however, involves children and so it is pertinent to ask if children 
Do they also have some legally protectable interest, 
aright of privacy? In Tinker v. Des Moines School 
urt intimated that at least some rights were 
and adults: “First Amendment rights are 
available to teachers and students. It can hardly be argued that either stu- 
dents or teachers shed their constitutional rights to freedom of speech or 
expression at the schoolhouse gate” (p. 506). However, the Court has also 
made it clear that children do not share equally in all provisions of the 
Constitution. In In re Gault (1967), children in juvenile court proceedings 
Were afforded some, but not the entire range of, due process protections 
granted adult criminals. In Ginsburg v. New York (1968) it said that it was 
rational for the state legislature to prohibit the sale of sexually related mater- 
ial to minors even though it would not be allowed to do so with regard to the 
sale of the same material to adults. In Baker v. Owen (1975), a famous 
‘school spanking” case, the federal district court of North Carolina readily 
admitted that it was questionable at best whether the law would condone 
any degree of corporal punishment of adults at the same time it was sustain- 
INg the right of the school to use a desk drawer divider on the buttocks of 


cl a ae 
Nildren to maintain discipline. a eo 
The Supreme Court's most recent discussion of abortion indicates that 

'N Some facets of personal life, certain children will be considered to possess 
conflict with parental 


wey rights even when their expression might co 
'Shes. In July 1976 the Court declared unconstitutional a state statute 


requ. i i = 
quiring parental consent before a pregnant minor could obtain an abor 


ti N : 
ne In so doing it said, “Constitutional rights do not mature and come into 
i attains the state-defined age of majority. 


In N 

BA oe fay Cagle ted by the Constitution and possess 
d of Cent. Mo. v. Danforth, 1976, 
Ithough the Court extended to 
ted to adults in the earlier abortion 


have similar rights. 
independent of parents, to 
Dist. (1969) the Supreme Co 
evenly distributed among children 


Con 


es 
and th Matters of procreation have r nt È an 
ws the independent right of privacy will be 
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The Informed Consent Doctrine 


The third avenue in this lengthy, but we hope helpful, detour, the informea 
consent doctrine, is closely intertwined with the right of privacy. w wu 
trine emerged as a rule of law in the context of physician-patient ma pon 
tice suits. The first clear expression of the concept was delineated over 
years ago: 


[U] nder a free government, at least, the free citizen’s first and greatest Le 
which underlies all others—the right to the inviolability of his person, in ale 
words, his right to himself—is the subject of universal acquiescence, and om 
right necessarily forbids a physician or surgeon . . . to violate without permiss his 
the bodily integrity of his patient by a major or capital operation . . . without M's 
consent or knowledge (Pratt v. Davis, 1905, p. 166) 


By the 1960s the contours of the legal duty of physicians to ee] 
significant aspects of proposed medical procedures to their patients ae 
been fairly well established. Generally, it is now held that physicians vIO i 
their obligations to Patients and subject themselves to liability for malpia 
tice if they fail to reveal potential dangers and other important facts conce" Š 
ing suggested treatment or withhold information concerning available form 


sof 
of treatment. (For some legal perspectives on informed consent see Bers" 
1976a; Goldstein, 1975; N 


bisd ; ine 
-determination” (Natanson V. ae 
© patient is entitled to all the 

poe intelligent choice before consenting 
medical intervention. 


e, 
ateriality of the risk. ; in a leading €35 
“Materiality may be said As defined in af 
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if apprised of an undisclosed fact or risk, then that fact or risk would be 
material. Some of the information falling within the materiality rule and thus 
necessitating disclosure are: (1) inherent and potential hazards of the pro- 
posed treatment; (2) alternatives to that treatment; (3) the likely result if the 
patient chooses to remain untreated. In brief, “To establish consent to a risk, 
it must be shown both that the patient was aware of the risk and that he 
assented to encounter iť’ (Waltz and Scheuneman, 1969, p. 643). 

There was no reason for the informed consent doctrine to be limited to 
physician-patient relationships. In many ways the insensitivity of behavioral 
and medical researchers to the interests of those they studied matched that 
of the healers and by the mid-1950s it was clear that scientists were not to be 
immune from legal constraints. In 1954 a group of professors from law and 
the social sciences recorded and studied the deliberations of juries with 
“bugging devices.” The researchers obtained the approval of the judges and 
the lawyers involved, but neither the jurors nor the litigants were aware that 
microphones had been concealed in the jury room. In 1963 three medical 
researchers injected “live cancer cells” into 22 chronically ill patients at a 
New York hospital with the approval of the institution’s director of medicine 
but without the fully informed consent of those injected. (For a lengthy 
history and description of these cases see Katz, 1972.) In 1972 the American 
Public was finally told that for 40 years, under the leadership, direction, and 
Buidance of the United States Public Health Service there had been a con- 
tinuing study of the effect of untreated syphilis in approximately 400 black 
males in Alabama. There was no evidence that consent for participation had 


ever been obtained. l 

Of ee nfluence as far as behavioral research is ia was 
Stanley Milgram’s study of obedience (Milgram, 1963). Central to the star- 
tling results achieved was the deception, by the experimenter, of the sub- 
Jects involved. To briefly recount the design, subjects were told thatthey 
Would be taking part in a learning experiment. Each subject was assigned to 


a Brou fi ee of whom, unknown to the subject, were 
era eT Toun people; KT the “learner’’ in the pseudo- 


ilgram’ i f the assistants was udo 
een to play the role of “teacher” pa ea 
Was to instruct the learner by administering an electric shoc w En ` 
€arner made an error in the memory task. The naive subject was put a : 
Control panel that regulated the shock from mild to extremely intense pi 
Painful. The teacher was told to deliver the painful stimulus Whenevei f e 
Carner erred. In reality, no electricity was hooked up to the panel an ne 
farning took place. The subject was deceived concerning the oar : 
© experiment, Learners deliberately made mistakes and pretended to tee 
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pain so that the real investigators could determine to what levels alas 
would raise the amount of electricity. When subjects hesitated they N 
urged to continue. Sixty-two percent of over 1000 ee wesc 
experimenter’s commands fully, raising the intensity level of the pa det 
stimulus to the highest point possible. The experiment achieved bar ae 
not only because of the results obtained but because of the reacio o D 
deceived subjects. They expressed shame, revulsion, anxiety, and extr 
tension during and after the experiment. f jë 
The ethics of conducting the research in the first place was soon Ai 
bated in the psychological literature (Baumrind, 1964: Milgram, 1964) ae 
eventually led to a reconsideration of the American Psychological sc ne 
tion (APA) Code of Ethics regarding research. That examination stimu a = 
the drafting of a lengthy and separate reformulation of ethical PR. 
concerning research with human beings (APA, 1973). In turn, these prın | 
ples led to a vigorous discussion in print regarding the efficacy of the one 
established Code (Baumrind, 1971: Berscheid, Baron, Dermer, and Libman, 
1973; Gergan, 1973; Kelman, 1972; Kerlinger, 1972; Menges, 1973; res 
nick and Schwartz, 1973; Waterman, 1974). Whatever the debatable points, 


bie jentie dat 
the APA—the major organization representing behavioral scientist Ne, 
least established minimal ethical guidelines for the design and impleme 
tion of research. Soon it wo 


nent 
uld be the turn of the courts and the governn 
to do the same. 


MERRIKEN v. CRESSMAN 
REVISITED: THE 
COURT DECIDES 


R . r i 1 
Despite the concern regarding the ethics of conducting research att 
mans, Mrs. Merriken’s suit against the Norristown school system an 


Ne only reported case in which the issu : 
Pavan oe bells a gathering is dealt with squarely. Althous” S 
was decided in a federal district court and does not have the far-reachi n6 
me Court opinion, because it appears to be! a 
ceived remarkably wide coverage in the Ea 
Note, 1974; Recent Cases, 1974; Recent 

so Bersoff, 1975). rt 
nal challenges Mrs. Merriken made, the en 
m seriously—the right of privacy. The a 
ee nature of the research instrument disrup 
family associations and interfe i 


ú- 
its 
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marriage, which the Constitution safeguards than that between parent and 
child. This Court can look upon any invasion of that relationship as a direct 
Violation of one’s Constitutional right to privacy” (p. 918). And although 
there was no precedent to the effect in the Supreme Court, the district court 
declared that privacy was entitled to as much constitutional protection as 
free speech. But who possessed this right—the student, the parents, or both? 
The court seemed ready to answer that question when it declared that “the 
fact that students are juveniles does not in any way invalidate their right to 
assert their Constitutional right to privacy” (p. 918). However, the court had 
not yet reached the essential question of whether the lack of consent by 
children to the invasion of their privacy would be sufficient to invalidate the 
research, Apparently reluctant to provide a definite answer it found a means 


to avoid doing so: 


In the case at Bar, the children are never given the opportunity to consent to 
only the opportunity to refuse to consent by returning a 
her this procedure is Constitutional is questionable, 
‘ace that issue because the facts presented show 
been properly informed about the CPI Program 
iven informed consent for their children to take 


invasion of their privacy; 
blank questionnaire. Whetl 
but the Court does not have to f. 
that the parents could not have 
and as a result could not have 8 
the CPI TEST. (p. 919) 


aportant issues; whether the failure 


In essence, the court evaded two in 5S the 
dently sufficient to constitutionally 


to secure the child’s consent was indepen 
discredit the research and second, whether parents as guardians can waive 
their children’s constitutional rights by consenting for them. Rather, the 
Court concentrated on Mrs. Merriken’s own right of privacy and found that 
she was unable to give genuinely informed consent to the invasion of her 
Personal life because the parental permission letter was so inadequate. The 
Court deridingly compared the letter to a Book-of-the-Month Club solicita- 
tion in which parents’ silence would be construed as acquiescence. The 
letter was also criticized as a selling device in which parents were con- 
vinced to allow children to participate. It was not, as it properly should be, 
an objective document telling parents of the potentially negative features 
and dangerous aspects of the program. The court then proceeded to lecture 


School officials and teach them an important legal lesson: 


The parents are not aware of the consequences [of participating] and there is no 
substitute for candor and honesty in fact, particularly by the school boa rd who, 
as the ultimate decision maker as far as the education of our children is con- 
Cered, should give our citizenry a more forthright approach. The attempt to 
Make the letter requesting consent similar to a promotional inducement to buy, 
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i ive wing, 
lacks the necessary substance to give a parent the opportunity to give knowing. 
intelligent, and aware consent. (p. 920) 


The last phrase in the quotation above is an important one i = 
serves some more attention. People may waive their constitutiona ne 
They may confess to crimes even though they have the right to N nr 
They may represent themselves in a criminal trial even though ee 
right to an attorney. But waivers of such strongly guarded cons = 
protections are permissible only if people first know they poss ei 
privilege against self-incrimination or the effective assistance of cou det 
critical stages of a criminal prosecution. It has been immutable th 
tional doctrine for the past four decades that waivers of constitutional r p 
must be voluntary, knowing, intelligent, and done with sufficient awaren ze 
of the relevant circumstances and likely consequences. It was in this oe 
that the request for permission was legally invalid. Mrs. Merriken had A 
right to waive her right of privacy by consenting to the research and ar i 
vention program. But because the request was little more than tiurekstering 
lacked the necessary substance to afford her the opportunity to meaningfu 
consent to the exploration of her personal life. in the 

There were more infirmities to the program than those apparent in 
information-gathering phase. There 


resentation, in its dissemination aspect. Recall that the promotional le 
promised confidentiality. But the prog 


: in inviolate from subpoenas an dby 
he could not determine the identity of children who have been labele tall 
; (p. 916). Parents were not 4 
informed of this possibility. 


| 
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prophecy, scapegoating by peers, loyalty conflicts between parents and 
children if the latter wanted to participate and were thus forced to reveal 
Personal family information to do so), but equally vulnerable, if not more so, 
were those children incorrectly identified. The latter possibility greatly con- 
cerned the court and in a statement that should terrify those who inappro- 
Priately rely on tests to diagnose and classify children, it said, “When a 
Program talks about labeling someone as a particular type and such a label 
Could remain with him for the remainder of his life, the margin of error must 
be almost nil” (p. 920). 

But was there no justification at all for the school system’s attempt to 
identify and treat potential drug abusers? Certainly one could mount a per- 
Suasive argument that a program designed to learn about and prevent drug 
abuse serves an important social end. Courts, when faced with the problem 
of the infringement of individuals’ important or fundamental constitutional 
rights, often consider the competing interests claimed by the public at large. 
For example, there is a heavy presumption against prior censorship of the 
Newspapers. But most of the Supreme Court agreed that if the Pentagon 
Papers had been published in wartime and had revealed current troop 
Movements, freedom of the press and the doctrine forbidding prior restraint 
of the news would have been submerged in the national interest. Thus, 
Courts will balance the interests of the individual against the interests of the 
State or society. In Merriken, the court acknowledged that if the program had 
demonstrated adequate public need and had restricted itself to a minimal 
invasion of privacy, it might have passed constitutional muster. But, after 
Studying all of the evidence, the court struck the balance in favor of the 


Individual: 


[T] he reasons for this are that the test itself and the surrounding results of that 
test are not sufficiently presented to both the child and the parents, as well as the 


Court, as to its authenticity and credibility in fighting the drug problem in this 
Country. There is too much of a chance that the wrong people for the wrong 
reasons will be singled out and counselled in the wrong manner. (p. 921) 


o catalogue a number of the serious 


As a summary, it may be helpful t 
on, wy! hat future researchers may avoid 


infirmities inherent in the CPI Program so t 
Its pitfalls, 


t technically sound. It did not possess 


1, The i ment was no ; 
he instru hiness to justify its use in such a 


sufficient psychometric trustwort 
sensitive area of research. 
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3; Those acting as participant-therapists (primarily school 
counselors) were considered undertrained for the tasks expected 
of them. Although the counselor who participates in the research 
of others may not be as culpable (in a moral, ethical, or legal 
sense) as the experimenter, it would seem appropriate for 
counselors to determine for themselves if the research they are 
requested to participate in is designed to protect the rights of 
subjects, data gatherers, and experimenters. 


3, The researchers failed to secure the affirmative, written, informed 
consent of the primary caretaker of the intended subjects, the 


children, who under traditional law are legally unable to consent 
themselves. 


The researchers gave inadequate consideration to the developing 
rights of the subjects, who may have had a sufficient protectable 
interest under the Constitution to require their personal consent. 


5. Absolute assurances of confidenti 
misplaced, thus makin 
invalid. 


ality were naive and , 
8 consent given under such false promises 


6. p was the possible dissemination of personal and potentially 
a information to law enforcement officials and a wide 
pectrum of school personnel, The problem was compounded by 


planned use of data banks fr : X h be 
: : a om whi i vould b 
easily retrievable. ch the information v 


as never made clear that the study propose 5 
m by it was experimental. The school adve 
ris what it was—an attempt to identify “e 
rough untested F s. In 
| > ; ed or unvalidated means. , 
e a ite weight. What the counselor may consider prac 
onsider research. It j Oe al ag At gst an 
their psychometric integrity » It is the nature of the instrument 


that determi il 
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d other 
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tional, and ability tests that are so valid that the “margin of error [is] almost 
nil.” The same is true for intervention techniques. Counselors may need 
-increasingly to think of their clients as participants in research and surround 
them with the protections that such persons deserve. 


THE STATUTORY RESPONSE: 
THE FEDERAL GOVERNMENT 
SPEAKS 


Courts develop rules of conduct in piecemeal fashion and only when lit- 
igants present legally cognizable issues. But rule-making bodies such as 
legislatures and government agencies need not wait for people like Mrs. 
Merriken to sue errant researchers. When law-makers determine that certain 

s can provide, when problems 


problems need a broader reach than court 
begin to affect a great many people, or for other good reasons, they begin to 


enact statutes and regulations that have comprehensive effect. This process 
has begun in human research. The year 1974 may be viewed as the 
watershed in that respect, offering further evidence that Reubhausen and 
Brim’s (1965) prediction that began this chapter is assuredly true. 

In mid 1974 the U.S. Department of Health, Education and Welfare 
(DHEW) published regulations regarding the protection of human subjects. 
These regulations govern the activities of those organizations who receive 
research funds or are accountable to DHEW. First published in the Federal 
Register (39 Federal Register 18917, May 30, 1974) and now codified as 
Federal regulations (45 CFR 46), the rules explicitly declare the 

€partment’s policy that “no activity involving human subjects to be sup- 
Ported by DHEW grants or contracts shall be undertaken unless a committee 
of the Organization has reviewed and approved such activity and the organi- 
zation has submitted to DHEW a certification of such review and approval 
"(45 CFR 46.102(a)). These institutional review boards are to make four 


mat 
Yor determinations. 

he subject are outweighed by both the 

and the importance of the knowledge to 


nt a decision to allow the subject to 


k Whether the risks to th 
benefit to the individual 
be gained so as to warra 
accept these risks. s 

= Whether the rights and welfare of tae so lia 
“subjects at risk” —will be adequately pr : 

3. Whether legally effective informed consent can be obtained by 


appropriate and adequate methods. 


380 LEGAL AND ETHICAL ASPECTS 


4 Whether the design calls for periodic review of the research. 


i i is 
Two definitions made part of the regulations are pertinent here. One 
the meaning of "subject at risk.” The term includes: 


[A]ny individual who may be exposed to the possibility of injury including 
physical, psychological, or social injury, 
subject in any research, development or 
application of those established and ac 
needs, or which increases the ordinary 


as a Consequence of participation as a 
related activity which departs from the 
cepted methods necessary to meet his 
risks of daily life (45 CFR 46.103(b)). 


attempt to conceptualize vf 
ed as the “knowing ape 
an individual or his legally authorized representative so situated as to be 

i ithout undue inducement or any 
element of force, fraud, deceit, duress, or other form of constraint or goer 
cion” (45 CFR 46.103(c)). More specifically, the elements comprising con 
sent include: 


e Fair explanation of the 
poses, includin 
mental. 


ggf 
procedures to be followed, and their es 
8 identification of any procedures that are eX} 


"O be 
e Description of any attendant discomforts and risks reasonably to 


expected. 

e Description of any benefits reasonably to be expected. 

e Disclosure of any appropriate alternative procedures that might ge 
advantageous to the subject, 

e An offer to answer any inquiries concerning the procedure. 

e 


. . L 
An instruction that the person is free to withdraw consent am 
discontinue participatin 


iudice 
i 8 in the project or activity without preju 
to the subject, 


representati 
blished the 
L. 93-34 


ve (45 CFR 46.119(b)). d the 
se regulations, Congress pate i 
8, 88 Stat. 342), Title II of wh 
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called “Protection of Human Subjects of Biomedical and Behavioral Re- 
search.” Its primary purpose was to establish a National Commission whose 
Major task is to identify basic ethical principles that underlie the conduct of 
human research. The Commission, now in operation, is composed of per- 
sons from medicine, law, ethics, theology, the physical and social sciences, 
philosophy, humanities, government, health administration, and public af- 
fairs. At least five of its members must be actively engaged in biomedical or 
behavioral research with human beings. 

In developing ethical principles, the Commission is charged with con- 
sidering ways in which it can be determined if human subjects are needed 
for planned research, constructing guidelines for the selection of human 
subjects, and arriving at a definition of informed consent. Another significant 
aspect of its work is to identify the requirements of informed consent for 
those persons whose capacity for giving consent is either absent or limited. 
In this category fall prisoners, institutionalized mental patients, and children. 
To accomplish this task the Commission is to consider the adequacy of 
information given to such persons about the research, the risks, discomforts, 
and anticipated benefits from the research, as well as the competence and 
freedom of such people to make a choice for or against their involvement. 

The concern for “limited capacity” populations was apparently stimu- 
lated by a recent decision that held that involuntarily detained mental pa- 
tients could not give informed and adequate consent to pt Se 
Psychosurgery (Kaimowitz v. Dep't of Mental Health (1973). he nn. ol 
this holding to prisoners is unclear because the patient in this ee een 
committed to a state hospital under a criminal sexual sh sii a 
Out a trial of his criminal charges for murder and mpe, ne es laity o! 
Consent was predicated on the inherently coercive atmosp a an institu- 
tional setting where release may depend on cooperation er those nn 
Ing Surgery as an alternative to indefinite confinement. The ee 
that the absence of meaningful choice on the part of one who has little 

argaining power could vitiate any consent given by one in that position. 


nissi ini mendations to the Secretary of DH 
he Co mission in its recomme kow .. ne 


(1976) | i f the 

ina 9) has rejected the rationale o l Eneo 

institutionalization may lessen the ability of prisoners enon os foneans 
ate “ncoerced choices, but asserted that irae kami from the 

Sen 4 i ntarily con l 

i Should not absolutely exclude ingen : entions are their best 


pane interv 
oP Portunity to benefit from new therapies if thas Inte 


fe} . ; ii a 
"only hope for recovery from dane aia of he institution in which 
© Commission focused on the isons and hospitals may have 


"esear 
ch might be conducted. Although Pr “free” choices, 
Potential for lining the capacity of their residents to make “free 
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the Commission believed it was possible to specify the necessary conditions 
under which research in closed institutions might continue to be supported 
by the federal government. With regard to prisons, for example (the Com- 
mission as of this writing has not yet completed drafting its guidelines for 
those committed to psychiatric facilities), it recommended that research 


charge proviso, the Commission also agreed that research on innovative 
and accepted practices that had the intent and reasonable probability of 


oe Prisoner—could only be conducted if the plann 
ehe mportant social and scientific need, if the reasons for 
& Prisoners (in contrast to “free living” subjects) was compelling, 
a voluntari f ective 
Participants and openness on the part of in Bene Fr openness 
ditions, opportunity to effectively redress 
participation from parole considerations, 
ear public scrutiny. 
ed on standards of conduct for institution 
© Capacity of the potential subject. As an altern?” 


participation by hmar A h in closed settings, it recommended researc) 
es where there is evidence that a relatively free choice 


is probable. Th i A 

e consequence is at once to respect the autonomy of the 
mulate positive change in living conditions = 
The recommendations are, of course, NO 


al 


nsent becomes even more complex when 
n or those involuntarily committed to men 
competent to make decisions Te populations are not always prest 
legally appointed rebre 5. Substitute or proxy consent by a paren e 

2 „Presentative has been the traditional solution but ae 
consultants—who fee| Nt na of the Commission, its staff, and IP 


z ; s is a 
basic denial of human dignity use of third Persons to consent for othe 


-It is this fundamental question of whether, 
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under what conditions, selected others may consent or refuse to consent to 
participation in research with which the National Commission for the Pro- 
tection of Human Subjects is now grappling. 

The Commission does not have the power to make regulations. It is 
merely advisory and in the two years of its originally scheduled existence 
(now three by virtue of an extension granted by Congress in October 1976) it 
will be limited to recommending ethical principles and guidelines to the 
Secretary of Health, Education, and Welfare. Finally, the guidelines, as they 
are developed and adopted, will pertain only to research sponsored or 
supported by DHEW. No doubt, however, any accepted measures will have 
significant influence on the conduct of research generally since the Com- 
mission is also making recommendations to Congress. To date, the Commis- 
sion has developed guidelines for the protection of fetuses, pregnant 
women, and products of human in vitro fertilization. The guidelines have 
since been adopted as as regulations, with the force of law, by DHEW. See 
40 Federal Register 33526 (August 8, 1975). Guidelines concerning prison- 
ers have also been published as proposed rules (see 42 Federal Register, 
3076, January 14, 1977) but have not yet been adopted as enforceable 
regulations, Also awaiting approval by the Secretary of DHEW are com- 
Pleted guidelines with regard to psychosurgery and children. 

_ This thicket of regulations, guidelines, codes, and statutes is no doubt 
Confusing. At the very least they may provide a ready reference for those 
WhO contemplate federal funding for their research. For counselors and 
Others seeking governmental assistance, it is imperative that they know what 
rules they will have to abide by to secure and maintain such funding. The 
'egulations are generally useful in designing any research and may have a 
secondary benefit. If challenged, research designs that rely on federal regula- 
tions will probably be accorded significant weight by the courts. Lastly, the 
Plethora of rules illustrates the progression from ethical standards, an 
i Only those researchers who belong to professional organizations but with 
ttle legal signifi s to judicial decisions, binding on only the litigants 
ny SGONCADCE, TO BE indi Il those contemplated by 

a} Ved, to statutes and regulations, binding aa search ts Sponsored by 
the ia Already, 90 percent of human ai ite > T idipate n 
eral government and for many who plan, i 


l'ese A 
arch, ethical constraints are now legal mandates. 


i. legitimate question may be raised as to whether all this judicial interven- 
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tion and legislative interference is indeed necessary. The jury bugging case, 
the Alabama syphilis study, and the cancer research at the hospital in New 
York are, perhaps, merely isolated anomalies. It can be charged that by 
using Merriken v. Cressman (1973) as an illustrative example, | have unfairly 
biased the case against research in institutions. The thoughtlessness of the 
researchers and officials who agreed to employ the CPI Program made 
Merriken an easy case to decide. The appealing nature of the plaintiff's 
charges allowed the court to iterate some easily applaudable statements 
concerning privacy and the rights of human subjects. But | should em- 
phasize that the defendant-school system lost, not because it sought to 
engage in personality research and intervention per se, but because the 
research design was flawed, the chance of error great, and the public need 
poorly demonstrated. Given all that, the decision was inevitable. 

But what of other instances where planned research does not suffer 
from such fatal infirmities? Does planning research well end the responsibil- 
ity of the investigator? The burden of scholarly opinion seems to say no, for 
there are other considerations beyond the experimental design. Inherent in 
all research, but especially in the behavioral sciences, is the conflict be- 
tween the interests of the researcher and those of the subject, a conflict 
perhaps best summarized in the following observation: 

The respect for privacy rests on the appreciation of human dignity, with its high 
evaluation of individual self-determination, free from the bounds of prejudices 
passion, and superstition. In this, respect for human dignity and individuality 
shares an historical comradeship with the freedom of scientific inquiry, which 8 
equally precious to modern liberalism. The tension between these values 50 
essential to each other in so many profoundly important ways, is one of the 
i of ‚modern liberalism. The ethical probier with which we are 
a cr ei of autonomy and privacy by 2 m 
lexi of test "Dy a modern awareness of the depth and € a 
plexity e forces that work in us implemented by the devices of a passionat 
en s awareness into scientific knowledge (Shils, 1959 pe: 


Similar note of this tension w 


as made b i 1967) 
before a Senate subcommitte 3 Paychalugier Bess: Saner | 


© concerned with government research: 
en Saat have a genuine obligation to devise protections for the righ 
Te a oo avoid mere psychic voyeurism. At the same time they a 5 
a e d ay to accumulate data-and meaningful generalization, 

owertul impulses of lo ili ition whic 
ae tee rely yalty, hostility, fear, and ambition 
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There is an obvious conflict between the need of society to know and the 
right of the individual to dignity and privacy. (pp. 757-758) 


The conflict between the needs and benefits of research and the integ- 
rity of the individual are nowhere more apparent than in the APA’s Ethical 
Principles in the Conduct of Research with Human Participants (1973). 
Principle 3 of these standards state, “Ethical practice requires the inves- 
tigator to inform the participant of all features of the research that reason- 
ably might be expected to influence willingness to participate, and to explain 
all other aspects of the research about which the participant inquires (APA 
1973, p. 29, emphasis mine). But, without a pause, it then cautions that 
“Failure to make full disclosure gives added emphasis to the investigator's 
responsibility to protect the welfare and dignity of the research participant’ 
(p. 29). Principle 4 exhibits the same ambivalence: “Openness and honesty 
are essential characteristics of the relationship between investigator and 
research participant. When the methodological requirements of a study 


eception, the investigator is required to ensure 


necessitate concealment or d 
" (p: 29, em- 


the participant's understanding of the reasons for this action 


phasis mine). 
The APA Principles undoubtedly reflect an attempt to mediate between 
he individual. Such a compromise 


the values of science and the values of t 

may be anathema to those who do not feel that human freedoms should be 

diluted (I will present that point of view a bit later on), but powerful argu- 

Ments can be launched against the invocation of what has been called 
An appeal to absolute ab- 


“ethical imperialism” (Gergan, 1973, p. 910). S a 
Stract moral principles may halt important research too abruptly without first 


Investigating whether informed consent and freedom from deception have 
any real meaning for research participants and in what ways they affect the 
accumulation of valid data. If research subjects remain unaffected by the 
Withholding of “all features of the research that reasonably might be ex- 
Pected to influence willingness to participate,” if they find un 
eceptions rather intriguing, if they do not care about the rationale o k 
esearch, and if their attitudes about life and themselves remat ou 
"egardless of whether ethical constraints are realized in an experiment, then 
&stablishing such principles poses unnecessary hardships for the scientist 
€rgan, 1973) as well as obstructing, and perhaps permanently ose 
© gathering of potentially important data that may genuinely serve toa val 
®neficially the environment, the individual behavior of people, and the 


articipant 
s themselves. Rr" 
In the behavioral sciences, participation IN research does not occur 


b 
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f i »athered, for 
through a unidimensional class of RE Data Dee, of 
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i i f ic behavior. 
Convert or unobstrusive observation or recording of public a 
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Disguised field experimentation in public situations. 
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studying the effectiveness of different styles of counselor-€ 
tion with counselors who are naturally different). 


: 35). 
Obtaining information from third parties (APA, 1973, pp. 30-3 


be 
i e y £ s may 
Thus, the argument continues, differing ethical ale for dis- 
needed for each kind of research setting. The easiest case i is behavior: 
pensing with informed consent in the covert observation of publi 


e 
nd not to b 


Involvement of individuals in this sort of research is minimal ¢ erience 


3 exp 
compared with that of research participants in the usual sense. Te get or 
of the “participants” is not affected by the research, and there 2 research (in 
negative effects on them. The case approaches that of nisana ae thought 
which the public acts of persons are studied without their consent b 


} s " (APA, 1973, F° 
necessary) or that of research with unobstrusive measures ... 
31). 


y and 
Covert observation does not necess 


F £ nrivac 
arily consist of violation of priv 
thus the subject may not need tob 


e informed: 


If a researcher bugs hotel rooms . . 
a clear violation of privacy. But wh 
interacting even withou 
of privacy . , 


js i 
havior this 
a grou 
asion 
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- to observe and record sexual be f 
en a researcher observes members oi inv 
t the knowledge of those observed, there Is as peor” 
. Most research situations in which psychologists Sant o 
are not private because there is ordinarily no communication or be 
personal and private nature (Kerlinger, 1972, p. 894). 


Can deception be similarl 
the researcher's obligation to 
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ption primarily to assure coopera y huma” 
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Without deception, it would be impossible . . . to obtain the kind of information 
that many psychological experiments are designed to produce. ... For those 
who value these lines of research because they represent contributions to 
knowledge—perhaps even to the betterment of the human condition—it is dif- 
ficult, therefore, to take the absolutist position that behavioral scientists must 
refrain from using deception in their experiments under any and all conditions 


(Kelman, 1972, p. 996). 


Deception methodology . . . often serves to facilitate the manipulation of inde- 
pendent variables that otherwise would not be amenable to rigorous investiga- 
tion and to minimize the extent to which “dema nd characteristics” are opera- 


tive in experimental settings (Berscheid et al., 1973, p. 913). 


Those who oppose rigorous adherence to the principles of informed 
about surveillance 


Consent in all research claim that a legitimate concern 
and deception by political, police and intelligence agencies has been dif- 


fused inappropriately into the research context: 


asis purpose of obtaining measures of variables. 
es observe people to obtain information on 
as defined by law or by the 
. . These two forms of obser- 
1972, p. 894). 


Research observation has the b 


<. Police and intelligence agenci 
the past, present, and possible future misbehavior 


agencies. They practice clandestine surveillance. . 
vation are utterly different in their intent and purpose (Kerlinger, 


and honesty is that research data 


One of the consequences of openness l f 
hwartz (1973) studied the effects 


may be significantly altered. Resnick and Sc : 
Of fully informed participation. Two groups were exposed to a simple verbal 
Conditioning task performed many times in laboratories with uniform results. 

Ne group, labeled ‘nonethical,”” was exposed to the task under the usual 
research procedures (i.e., they were not told the purpose of the experiment). 

Ne second group of subjects, labeled “ethical,” was exposed to the task 
after being told explicitly of the purpose, procedure, and hypothesis of the 
Study (i.e., to reinforce the use of certain personal pronouns through verbal 
Conditioning), The results showed significant positive conditioning by the 


Nonethical group. The 14 subjects in this group increased the use of “I-We” 
d by the experimenters) from a 


Pronouns 3 inf 
ns (th systematically reintorce > 
CO ROA : f 14.43. The ethical group 


Mean of ; iadi of 

an of 7.00 before conditioning to a mean ; 

Started at the same level (mean = 7.21), but they decreased their use of 
s to 5.07. 


"We" pronouns in equivalent trial u 

Resnick and Schwartz (1973) found that major unanticipated problems 

i Ere encountered in conducting their experiment that related directly to a 
Onditions under which the groups were studied. Few people volunteer: 
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f i int- 
for the ethical group and those that did missed more than half nn of 
be = In contrast, none of the nonethical group were ever > ek ib 
el of cooperation of those in the ethical group it .. er 
complete the experiment; those in the nonethical group V 
week. From all this the authors concluded the following: 


= chological 
It is possible that people lose their interest in partic paring va An This 
research when it is disclosed fully to them what the researc p ante andl ie 
may suggest that people enjoy an element of risk and pie lpr ohiek 
come bored rapidly with the prospect of participating in er manana þe: 
they already have knowledge. . . . [Another] possibility ist re Lt and stay 
come very suspicious when the experimenter is so totally dis 
away altogether (p. 137). 


f 300 
Epstein, Suedfeld, and Silverstein (1973) found that 80 Se 
college students surveyed expected that they would not be tolc pitat 
of the experiment. They considered nondisclosure a generally ry teception 
feature of research participation. Only 6.7 percent considered fe “ter was 
inappropriate to the research setting and thought that the ic pe ee that 
obligated to be honest. The only strong demand the students mad RTE to 
the researcher provide clear instructions. There is also some evi 
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suggest that the need for Information is correlated with the nat 


satiate 
s - ; articipa 

experiment. If the study is perceived to be nonstressful, desire to p 
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knowledge regarding human b 
adherence to the informed con 
vast majority of research deali 
ously curtailed (Gergan, 1973 


z : : > tha 
jects but there is evidence th f impo 
etrimental to the attainment © 


15 
igor 
là % x z der rig 
ehavior. Field experiments, un and thi 


, ; ssible . 
sent doctrine, would be imposs he set! 


LEGAL AND ETHICAL CONCERNS IN RESEARCH 389 


she says, “when the objectives and commitments of the investigator directly 
conflict with the well-being of the subject, and the code of ethics should 
contain provisions that at such times unequivocally protect the subject from 
the investigator’ (Baumrind, 1971, p. 887). Children, she feels, deserve 
special attention. Their right not to be harmed or alienated “must supersede 
the rights of the investigator to know and to report” (Baumrind, 1971, p. 
887). Once society permits some subjects to be deceived or uninformed 
because it endorses investigators’ claims to the overweaning significance 
and reasonableness of their scientific objectives, then the dilution of indi- 
Vidual freedoms begins (Shils, 1966). 
. Just as alarming is the possibility of alienation as more and more sub- 
jects are treated dishonestly. Baumrind (1971) believes that people are less 
affected by the pain and stress of some experiments than by the loss of trust 
in themselves and the investigator: “The more serious harmful consequence 
lof deceit] may be that the subject is taught that he cannot trust those who by 
Social contract are designated trustworthy and whom he needs to trust in 
order not to feel alienated” (p. 889). Thus, not only will continual deception 
and involuntary participation jeopardize community support for research 
e.g., Nettler, 1959; Sheets, Radlinski, Kohne, and Brunner, 1974) but it can 
invalidate data as more and more “subjects” become suspicious of all re- 
Searchers and begin to distrust even honest communications. Eventually, 
Cynical citizens determined not to be made fools of may refuse to help 
Benuine victims, misperceiving real-life events as elaborate field experi- 
Nents, 


a study in which the experimenter’s accom- 
as 
„An observer notes the amount 


fact that such events may occur 


Take a hypothetical example ... 4 
Plice feigns a heart attack in a public place. . 


and type of help that people offer him. . . . The 
Ip that people © $ 
naturally does not, of course, justify staging them for research purposes. In the 


long run, the proliferation of such experiments would add pie en consid- 
erable degree of deceit and irrationality that pervades mo = me se 
Public awareness that such experiments are taking place wou “a = = o 
the “pollution” of the research environment - - - but also ie e ambigi yo 
real-life situations that call for helping behavior (Kelman, 1972, p. t 


f Id subordinate the 
Perha | concern of those who wou c t 

aps the fundamental co AOR lf es 
"esearcher’s right to investigate to the individual s right to privacy IS the 


s Umanizing effect of secrecy and deception. 


m toward goals which you—the social 


To j 
Manipulate men, to propel the deny their human essence, to treat them 


reformer—see, but they may not, is 10 
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as objects . . . to degrade them. That is why to lie to men, or to deceive pa E 
is, in effect, to treat them as sub-human, to behave as if their ends are A 
ultimate and sacred than my own (Berlin, 1969, p. 137; see also Jourard, 1966). 


Researchers tend to regard experimental situations as isolated from the rest 
of existence so that the usual standards of interpersonal ethics need not 
apply (Kelman, 1967) and so do things to subjects they would never do a 
other interpersonal relationships. But, by forgetting that the researcher 
participant relationship is also a “real interhuman relationship” and judging 
the experimenter’s conduct purely in the context of scientific contribution, 
“deception—which is normally unacceptable—can indeed be seen as 4 
positive good” (Kelman, 1967, p.5). Ultimately, “where society's sanc- 
tioned procedures exhibit a disdain for the value of human personality, that 
ideal is not likely to flourish” (Kadish, 1957, p. 347). 

In sum, then, the fully informed involvement of human participants 
makes four significant contributions. 


[It] serves society’s desire to respect each individual's autonomy and his right to 
make choices concerning his own life. Second, providing a subject with intor 
mation about an experiment and encouraging him to be an active partner in the 
process may also increase the rationality of the experimentation process. 


Third, securing informed consent protects the experimentation process bY 2 
Couraging the investigator to question the value of the proposed project and t 
adequacy of the measures he has taken to protect subjects, by reducing civil m 
criminal liability for nonnegligent injury to subjects, and by diminishing advers 
public reaction to an experiment. Finally, informed consent may serve the func- 


tion of increasing society’s awareness about human research (Katz, 1972: 
PP. 523-524. 


AN ANALYTIC 
FRAMEWORK FOR 
PLANNING RESEARCH 


As a way of providing some co 
be helpful in this final section 
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Promote, not inhibit, research. As indicated early in this chapter, much of 
the concern about research has involved nontherapeutic experimentation 
involving drugs or medical procedures. Counselors have created little, if any 
concern. And—with the possible exception of behavior modification re- 
search, designs predicated on deception, or the use of psychological tests 
—social science research has escaped scrutiny. However, in an effort at 
completeness and to alert counselors to possible problems not entirely ir- 
relevant even to the most benign research, | believe the following material 


will be useful. 


Seriousness of the Need to Conduct Research 


Studies may be characterized as therapeutic and nontherapeutic although 


the distinction is not always clear and consistent. Therapeutic studies are 
those likely to produce direct benefit to the participant. Subjects in such 
Studies may be classified as intended beneficiaries. Nontherapeutic studies 
are often, but not always, designed to contribute knowledge about the class 
Of persons of which the subject is a member. Here, where only the class, but 
Not the particular person, may profit, subjects In nontherapeutic research 
May be classified as incidental beneficiaries. Other types of ai ani 
research are those studies in which the particular class of a chosen is 
irrelevant but is selected only because it is conveniently an a ns ox 
__ In evaluating the need to conduct research, the re = er 
Be two dimensions—the potential en re Tn j PA to 
© the indivi rect. The greater the rs s ) ; 
the Ladle oe or the more the design includes subjects who 
Will go untreated, the stronger should the experimenter inhibit pursuing the 
"esearch at all. A great deal of research not only is an intrusion into persona! 
Privacy but “also quite useless and unnecessary from any serious s 
Point, | | | Much of it is frivolous self-ind 


ulgence of the professional of intru- 
Sion” (Shi ch of what the counselor 
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clude unwa 


rranted invasions of privacy. 
nd carefully designed program evaluation 
onal data Or provide immediate 


thetical con 


One could construct a SYP" ar the end where the least com- 


ajo P 5 a k 7 

Pelli, reference points might be placed. Ne 
p > 2 

harm 8 "€ason for doing research 


Feten 
the individual and that promise only vaguely ta betel N Y 
wh i) W 

A 


\ 


ouid be oat ate NOSE wett 


392 LEGAL AND ETHICAL ASPECTS 


phous societal interest. In the middle, perhaps somewhat toward the end 
favoring research, are those studies that enhance institutional decision- 
making, have no presently demonstrable benefits for the subjects themselves 
but may aid others like them in the future and possess no more than minimal 
risk and inconvenience for the incidental beneficiaries. Most compelling are 
those studies directly aiding the participant. 


Availability of Alternative Methods to Meet the Need 


When governments curtail individual liberties to achieve a state goal, courts 
will often declare the method used to achieve that goal unconstitutional. 
They will impose on the state the duty to devise a less drastic means for 
accomplishing its purposes. For example, the state would not be permitted 
to exclude children from public school simply to save money. Instead, the 
court would order the school board to seek a less drastic alternative such as 
raising to taxes or increasing class size. . 

The same principle can be applied to research. Even if the research aim 
is laudatory, the experimenter should consider the availabil ity of instruments 
and methods that will not coerce, deceive, leave treatable subjects un- 
treated, or invade Privacy. For example, if research on children is contem- 
plated, there should be evidence that the planned study cannot be con- 
ducted on adults, that the knowledge to be gained can only be obtained if 
children participate, and that the information desired cannot be gleane 
from natural, nonresearch settings. With prisoners or other institutionalize 
are relevant. 
gs such as prisons and hospitals who engage 
e to the possibility that they might be using 
cause the population is stable and controlla- 
ay directly benefit the participants. Given sh 
ducted research, this is unlikely, but it IS we 
£ / at considerations of equity demand that the risks © 
research, including the invasion of privacy, be distributed among the tota 
population, not only those who are accessible and acquiescent. 

More likely, it is possible that some research specifically designed . 
help some participants may leave others untreated. For example, consider ¢ 


; ; i 5 
study in which a vocational counselor seeks to discover whether rehears4 
of job interviews better p 


training. In Pursuit of this knowledge, the counselor systematically rehearse? 


C o 
chosen at random and leaves untrained a seh 
earsed group will be more successfu 
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receiving job offers. But what of the untrained group? By virtue of inclusion 
in a research protocol—notwithstanding its intention to benefit some of the 
Participants—the untreated control subjects receive significantly fewer job 
offers, a consequence of major economic and psychological importance in 
their lives, Alternatively, given the scarcity of counselors, it is quite possible 
that access to their services might be predicated on agreement to become 
Part of an experiment. Even with full disclosure of risks and benefits, such 
Participation may be seen as coerced and inherently unethical. It is in these 
Situations that counselors might wish to pursue other than a research context 
to study certain questions. 


Soundness of the Research Instruments 


Counselors and other practitioners should use only those instruments useful 
IN Making appropriate decisions about persons and that possess demonstra- 
ble Psychometric integrity. Many assessment devices fail to meet these 
criteria (Bersoff, 1973). Projective testing, for example, continues despite the 
hich these tests are based have been chal- 
enged and found to possess little substance (Murstein, 1965). A major con- 
Cern in Merriken, it may be recalled, was that one of the end products of the 
research Program was the classification of children as potential drug abus- 
ers, The court criticized the assessment tool that would select those particu- 
ar children, not only because of its personal nature, but because its validity 
AS unproved. 


a 5 
act that the assumptions on w 


apply when the purpose of the 
and validity of a new instrument. 


’ Participants deserve a variety of absolute protections. No decisions of 
Ind Concerning the subjects should be made on the basis of test results. 
One of the information gleaned from the instrument should be dissemi- 


ated. All test results should be destroyed or protected from subpoena (see 


Stin and Boruch, 1970: Holtzman, 1971, for descriptions of such proce- 


u : ate 
nee No personally identifiable information should be attached to the test 
Ults if there is some compelling reason tor their maintenance. 


n 


Recoon; | 
Fl i on of Private 
Worigg tion of the Right to Consent to the Invasi 


If so 
Ness Pgs Including its scientific communit 


nthe principle of self-determination, 


y, believes in individual human- 
and in the right of people to be 


394 LEGAL AND ETHICAL ASPECTS 


secure not only in their homes but in their thoughts, then it becomes 
sary to develop means to obtain, to the fullest extent possible, the oe ees 
those asked to become participants in research. There are, no dou sh a - 
cal barriers to genuine informed consent (see generally, Katz, 1 972, > 
609-674), the problems of which are magnified when the principle it 
plied to those with limited capacity to consent. Nevertheless, er 
should feel duty-bound to strive toward that ideal by more complete 
rn adherence to the informed consent doctrine need not mean i 
end of research, including those studies that depend on covert apee 
or deception. The use of some modicum of ingenuity might satisfy the Kr 
of both researcher and participant. For example, a pool of possible po : 
could be told sometime in advance that they may be deceived or the 


behavior secretly monitored, though the 


y would not be told when er 
They could then be given the chance not to participate. If Resnick © 
Schwartz (1973) 


are correct, subjects may fully agree to such agnato 
because of the possibil ity of risk or excitement. There may be a more gA 
sive reason for obtaining consent before one engaged in covert as : 
Some states make it a criminal offense to overhear conversations bers 
listening device unless all the participants to the conversation are a 5% 
cally informed. Oregon’s law to that effect makes failure to inform punts er 
ble by a fine of up to $3000, imprisonment for not more than three aoe 
both (Ore. Rev. Stat. §§ 30.780, 165.540(6) (1973)). A similar statute - 
in Maryland. Reubhausen and Brim (1965) point out that such statutes a 
cord no exemption for behavioral research. om 
The unanswered question in Merriken v. Cressman (1973) BT 
ained. There is no problem, of course, I nt 
n that instance, it is the individual Ra 
in research conducted in colleges, in ge 
ally handicapped, or in the pula fo 
vocational or employment counseling, it is imperative for the participan ine 
subject is a child or is retarded = bo 
ility? For children one can invoke 


i the 
he other is the legal doctrine supporting 


: children and to be ultimately respons!? 
for their eduction, Thus, under eith 
that parents consent to any propo: 


Fe ntia 
er one or both of the above, it is ess 
sed research. 
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However, as Reubhausen and Brim(1965) inquire, “In the case of chil- 
dren... while the legal principles may be clear . . . should not a child, even 
before the age of full legal responsibility, be accorded the dignity of a private 
personality?” (p.1200). Many writers, | among them (Bersoff, 1976-1977, 
19765; Holt, 1974; Wald, 1974) have suggested that children’s rights be- 
come more specifically tailored to developmental levels rather than tied to 
arbitrary age limits. Unless there is a significant risk of irreversible damage or 
clear and convincing empirical evidence that at particular ages children 
have not sufficiently developed skills to exercise discretion, neither parents 
nor the state should have the right to make unilateral decisions that mean- 
ingfully affect children. On a purely methodological base, coerced partici- 
Pation leads to uninterpretable, invalid data. 

For those institutionalized because of retardation or psychiatric inter- 
vention, proxy consent should be avoided to the maximum extent possible. 
In a paper written for the National Commission for the Protection of Human 
Subjects, Joseph Goldstein, a professor of law at Yale University, argues 
strongly that the only one who should consent to research is the potential 
Participant. 


The burden in law for incompetence should be very high. No evidence other 
than a showing that the patient is comatose should ordinarily be accepted as 
Proof of incompetence. . . . Respect for human dignity should not lessen accord- 
ing to an individual’s mental health. But practice does undercut that respect by 
making provision for “substituted consent” by a legal representative who may 
be forced upon them without their “informed consent.” To accept such proxy 
Consents is to authorize invasions of person and personality without regard to 
the wishes of the research subject—that is to deny them freedom to choose 


Without saying so (Goldstein, 1976, P. 26). 


Thus, primary concern for the autonomy and integrity of the individual 
may dictate that decisions regarding participation in research be honored 
regardless of institutionalization or adjudication of incompetency. Possibly, 
When there is a readily identifiable, direct, and substantial benefit to the 
health, functioning, development, or well-being of the individual and the 
Individual cannot consent, then a person nominated by the potential subject 
to act on his or her behalf may consent in the subject's stead. In the event 
that no such person is or can be nominated, then perhaps a legally ap- 
t with the provision that the person 


Pointed : vente 
representative may consen aot 7 
i J act as the individual might 


€signated has been determined most likely to 
ave acted if able to. 
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Capacity for Limitation and Control of Data 


> : ral and 

The storage and dissemination of research data is as much of a ats 
ethical concern as its gathering (for a general discussion of the Bi | by the 
Lister, Baker, and Milhous, 1975). The problem u — u eh „of 
development of government data banks. “The maintenance and feria Tai 
information for purposes other than that originally agreed to, alia er 
of confidentiality inherent in its continued maintenance, strong oe ihre 
that the proper course of [those] possessing such data is either too p ie, 
consent of the individual involved to its continued preservation, or 
stroy the data. . . ."” (Reubhausen and Brim, 1965, p. 1206). herior 

At this point, there is relatively little protection for the N on 
subject. First, there is no such recognized entity as a ee 
privilege. In many states now, clients of psychologists in private pra thee 
have been accorded the statutory right to privileged commenieatiai a 
the right of the client to prevent licensed psychologists from testifyin = 
Court about communications revealed within the context of a protesia : 
relationship), but there is no counterpart for scholars. The case for a hse 
privilege has been made persuasively (Nejelski and Lerman, 1971) bu ion 
been rejected by the courts, at least in the context of a criminal ba aee 
(the major case is United States v. Doe (1972): for refusing to reveal e 
sources to a grand jury, Professor Samuel Popkin of Harvard spent eight me 
in prison for contempt). In addition, researchers cannot guarantee some = 
confidentiality of data in light of the ability of law enforcement personn 
compel the production of records by subpoena. ; one 

In an attempt to Provide some protection for human an er 
group (Carroll and Knerr, 1976) has suggested that all social science orga 


A : ’ i a liga- 
zations adopt the following statement as part of the scholar’s ethical oblig 
tion to protect confidential sources and data: 


vulge either 
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when a counselor studies the long-term efficacy of an experimental counsel- 
ing technique. In that instance coding may help but there is still the danger 
that the code may be broken and the information retrieved. Although most 
researchers find the idea of data destruction abhorrent, destruction of per- 
sonally identifiable information is another possible safeguard. Some innova- 
tive scientists have suggested the use of storage in foreign facilities (Astin and 
Boruch, 1970) out of the reach of domestic government agencies. At a 
minimum, as part of the informed consent process, children and their par- 
ents should be told of any conceivable limits to the promise of confidential- 
ity. Naive promises of a guarantee of secrecy are misrepresentations of 
reality. 


A FINAL NOTE 


This chapter has detailed the consequences when behavioral scientists and 
Practitioners act with insensitivity toward those they study. Invocation of 
“science” as a talisman to protect those who harm others is no longer 
Possible, Because of those who sought to benefit humankind to the detri- 
ment, deception, and denigration of human beings, there is now a vast 
Network of external control monitoring the experimentation process. The 
absolute prohibition, in most instances, of the use of certain research in- 
struments or designs would be intolerable in a free society, yet freedom also 
requires that those who are asked to reveal their personal selves be treated 
With respect for their individual integrity. =. : 
When genuine societal interests permit the invasion of privacy without 
Consent, there should be broad sharing of the responsibility for doing so. 
Potential research participants should be invited to engage with the 
researcher—become ‘joint adventurers” to use Paul Ramsey’s (1970) 
Phrase—in a dialogue concerning those aspects of the research that might 
invade privacy, either in its gathering or in its dissemination. | am con- 
Yinced, with Freund (1969), that comprehensive involvement in the de- 
Clsionmaking process will not only improve the design of studies but will 
Nave the more important effect of acknowledging the equality, mutual in- 


terests, and individuality of all participants. 
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CONCLUSION 


CHAPTER 14 
Epilog 


Leo Goldman 


This book obviously does not contain all there is to say about research in the 
Counseling field. We have selectively emphasized those methods that ap- 
Pear to us to be of greatest value to the largest number of applied workers in 
the field—practicing counselors and other helpers. Further, we have for the 
Most part emphasized those applications of research methods that reflect the 
Cutting edges of our field in several settings. Essentially we look at research 
Pragmatically: it should make some contribution to the people and organi- 
zations that counselors serve. . 

This is in no way to imply a value judgment about the comparative 
Merits of so-called basic research and applied research. But we are saying 
that the research done in the counseling field up to now has neglected the 
less formal and less quantitative methods. We are also saying that research 
Will not contribute all that it can in this field if practitioners themselves do 
NOt participate actively in the identification of topics to be studied and in the 
Planning and conduct of research. . 

The necessary changes will not be easy to accomplish. Psychology has 
been struggling for decades with the notion of the scientist-practitioner. 
i a small number of psychologists who are active as 
oth scientists and practitioners, they are a tiny minority of all psychologists. 

think that a major reason for the failure of this model is the unrealistic 

expectation that people who are practitioners at heart will do truly “scien- 
iie" research, which usually means using advanced and complex designs 
and statistics and building research on well-developed theoretical founda- 
‘IONS, This is too much to ask of all but a tiny percentage of practitioners; 
Indeed it is a great deal to expect of most research specialists. 

Our vision of the effective practitioner is a person who is constantly 
alert to the needs of the people and institutions being served and constantly 


though there are indeed 
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evaluating the usefulness of current programs and activities. ne ta 
titioner is already a researcher in our conception of research. ne in 
delineated in this book are in some ways no more than systematic = on 
tions of methods available to effective counselors to study nee Ae 
evaluate activities. It is our belief that every counselor, in whatever done y 
and whatever setting, should find in this book at least a few met nes 
research that would be useful in that specialty and setting. There sont 
practical problem of reaching the point where practitioners do use thes 
thods. : F 
= ie there are many reasons why counselors (and ie 
plied practitioners in almost all fields) have not done research of any kind. 


: ; xing that 
least briefly we should address ourselves to suggestions for changing 
situation. 


COUNSELORS AS 
RESEARCHERS: 
MAKING IT HAPPEN 


To attain that brave new world whe 


i ch, a 
re numbers of counselors do researc’ 
number of changes must occur. 


Training of Counselors 


ange to introduce is in preservice os 
S in research methods, and advisors to 
hould be able to extend their capil 
is book. They may well face ee 
ues and even from former tuden ay'S 
hard way, there is no reason ee jude 
profession without the rituals that ine!" 


traditional research approaches tha 
mostly to make theoretical contributions. aden 
plays a key role in this effort to agn 
with doctorates occupy influential pa ams 
ors and supervisors of counseling prag a es 
f journals, and officers and committee iso 
associations. It is therefore vital that doctoral adv’ 
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and committees recognize that in the human behavioral fields the qualita- 
tive and even subjective methods of research are not only acceptable but 
even desirable methods of scientific progress, as well as major contributors 
to the solution of practical problems faced by practitioners. For both reasons 
doctoral students should be encouraged to select from a broad variety of 
both quantitative and qualitative research methods. 


Journals and other Publications 


One very important way to increase the recognition and “‘respectability’’ of 
these less quantitative methods of research is to have them accepted by 
Professional journals as worthy of publication. Of course, this pertains only 
to those studies that have some degree of generalizability. There is not much 
reason to publish reports that sought only to answer local questions, except 
Perhaps in some instances as exemplary models for others who wish to study 
Similar questions in their own locality. 

To accomplish such a change in publication practices will require a 
Major policy decision on the part of most journals. For many of the journals 
it will be necessary to add to their editorial boards or panels of reviewers 
People who understand and accept the nonquantitative methods of re- 
search, For all journals it will be necessary that the persons designated as 
editors have a broad conception of what is publishable research. 


Convention Programs and Workshops 


Similarly, those responsible for planning convention programs are in a key 
Position to define what are the acceptable types of research. This means not 
Only accepting program proposals that utilize the kinds of research we have 
Stressed in this book, but also planning sessions of a workshop or sym- 


Þosium nature that will help people understand these methods and learn 


tow to use them. f an: k 
It will also be valuable for associations, and other who sponsor work- 


Shops apart from conventions, to offer workshops that provide specific train- 
Ing in using these methods of research. 


Research Awards 


A Number of professional associations seek to encourage good research by 

Blving awards for the best published research they can find. Certainly the 

STiteria for such awards should not be such as to exclude the less quantita- 
: awards s$ 
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tive studies. This will require revision of some of the rating ha el 
this purpose that presently do exclude qualitative types of pa r ae A = 
only questions (about sampling, statistics, etc.) that are applice 

iti methods. i 
sae roe instances it might be necessary to have two or more en 
of research for which awards are given. In a way this would ge =a 
ideal, because of the likelihood that there will be implicit or explicit ¢ a 
tions between first-class and second-class types of research. But mee er 
still be better than restricting such awards only to the traditional studies er 
contain all the stereotyped sections on “hypotheses,” “methods, gem 
and so on, but that are often devoid of any real significance for the i 3 

It would also be most desirable to grant awards to exemplary pai 

studies, many of which are not necessarily appropriate for publication. 7 
the purpose would be to recognize the contributions made locally re 
than to any more widespread generalization of the findings. 


In the Field 


If counselors on the job are to do research of any kind, it is vital that their 
employers regard research as not only an 
use of counselor time, Perhaps it will be e 
case in the past if studies can be show 
agency or institution in the conduct of its 
the case if the action-oriented kinds of r 
that stress precision of measurement 
niques. 


There still remains the problem of time 
directors, and board members th 


acceptable but even a che 
asier to do this than has been En 
n to offer very specific help to = 
affairs. And that is more likely to DC 
methods are used rather than pies 
and use of esoteric statistical tec? 


Š EENE aryisors 
and of convincing PURON ai 
‘ 5 er 3 

at their total enterprise will in the eee 
benefit if counselors take a few hours a week from services and use that ti 


Le na 
to study the people and communities they serve and their own work. It ; a 
be necessary for counselors to start the ball rolling by doing a study on th Rs 
own time first, to demonstrate its value. But it will no doubt require contin 


; EN S j 5 ort 
ing effort for counselors to receive both the time and the necessary supp 
to do research as part of their jobs. 


The Place of the Research Specialist 


R . R $ R ap 
Finally, it will be extremely important that we find ways to bridge the er 
a 
between researchers and counselors. Certainly there will always be a ma) 
place for specialists in research, no matter how much research is done 
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counselors. The research specialists will be needed as consultants to prac- 
titioners who are doing research, and they will be needed for the planning 
and conduct of large-scale studies that go beyond a single institution or are 
simply so large in scope that they cannot be done by any save full-time 
researchers. And, of course, there are the more technical kinds of research 
that are beyond the knowledge, skill, and interest of practitioners, but that 
will benefit from the counselor's input, as described by Harmon in Chapter 
2 

One way to bridge the gap is for agencies and institutions that employ 
counselors to establish working relationships with research specialists who 
are interested in applied problems and needs. Ideally this is done on a 
regular consultant basis, so that the researcher meets regularly with counsel- 
ing staff to help stimulate research and help them plan studies. If this is done, 
we will very likely have much better evaluations of experimental projects 
than we have seen in the past. One reason for the inadequacies of the past is 
that the research specialist, when involved at all, is brought in after the 
Program has been planned and funded and even after it is under way. 
Another reason, at least in some instances, is that the researcher is not 
sufficiently attuned to practical concerns and is interested in more theoreti- 
cal models of research. Under those circumstances it is almost inevitable 
that there will be frustration for all and regrets about the limitations of the 
evaluation outcomes. When a practice-oriented researcher teams up with 
research-oriented counselors early in the process of developing programs, 
We can expect much more effectiveness and satisfaction for both. 

Still another place for the research specialist—and another opportunity 
to bridge gaps—is in programs and activities aimed principally at research 
dissemination. Fortunately, at the time we go to press, there is considerable 
Support for research dissemination activities, in the form of federal grants 
and specific projects in some of the counseling specialty areas. Too often, 
researchers have ended their efforts with the results section of the report and 
Often have to be pressed to engage in any discussion of the implications of 
their results for practice. On the other side, practitioners find it difficult to dig 
into published research because the sections on related theories, methods, 


and results are so far from their interest and understanding. 


Systematic programs for research dissemination will demand better 


Communication between research specialist and practitioner than has been 
e case in the past. It will also require imaginative use of audio-visual 
techniques and of workshops and other formats that maximize communica- 
tion and collaboration. There will no doubt be many frustrations, as prac- 
titioners discover how limited can be the immediate applications of most 


Studies, and as researchers learn how limited is the practitioner's interest in 
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research as an area of functioning in itself and how impatient the prac- 
titioner is to have immediate answers. At best, this will be a difficult enter- 
prise, but at best it can increase the interaction among research, theory, and 
practice that Harmon describes in Chapter 2. 


TWO SIDES OF 
THE SAME COIN 


We might well conclude this chapter and this book by repeating the princi- 
ple that has appeared a number of times in earlier chapters, namely, that in 
many ways research and practice are two sides of the same coin. Ideally, the 
researcher is trying to understand better how people and organizations func- 
tion; ideally, the practitioner is trying to help those people and organizations 


to function better. By bringing together these two efforts, we should have 
both better research and better practice. 


APPENDIX A 


BOOKS ON 
MEASURES AND SCALES 


Bonjean, C.M., Hill, R.J., and McLemore, S.D. Sociological measurement: An inven- 
tory of scales and indices. San Francisco: Chandler, 1967. 


Chun, K., Cobb, S., and French, J. R. P. Measures for psychological assessment. Ann 
Arbor: Institute for Social Research, The University of Michigan, 1975. 


Dailey, C. A. Assessment of lives. San Francisco: Jossey-Bass, 1971. 


Goldman, B. A. and Saunders, J. L. Directory of unpublished experimental mental 

Measures. New York: Behavioral Publications, 1974. 

Hoepfner, R., Stern, C., and Nummedal, S. G. (Eds.). CSE-ECRC 
Preschool/kindergarten test evaluations. Los Angeles: UCLA Graduate School of 
ducation, 1971. 


ansen, P., and Patalino, M. CSE elementary 


Hoepiner, R., Strickland, G., Stangel, G., } , i 
Graduate School of Education, 1970. 


school test evaluations. Los Angeles: UCLA 
Horst, p, Personality: Measures of dimensions. San Francisco: Jossey-Bass, 1968. 


Johnson, O. G., and Bommarito, J. W. Tests and measurements in child develop- 
Ment: A handbook. San Francisco: Jossey-Bass, 1971. 


Lake, D.G., Miles, M.B., and Earle, R.B. Measuring human behavior. New York: 
eachers College Press, 1973. 


Loevinger, J., and Wessler, R. Measuring ego development, Volumes 1 and 2. San 
"ancisco: Jossey-Bass, 1970. 


and Head, K. B. Measures of occupational attitudes 


Robi i 
Anson, J. P., Athanasiou, R., h J ( ; 
n Arbor: Institute for Social Research, The Uni- 


vers, Cupational characteristics. An 
Silty of Michigan, 1969. 


ead, K. B. Measures of political attitudes. Ann 


Robinson, J. P., Rusk, J. G., and H r 
The University of Michigan, 1968. 


r s H 
Or: Institute for Social Research, 


415 


416 CONCLUSION 


Robinson, J. P., and Shaver, P. R. Measures of social psychological attitudes. Ann 
Arbor: Institute for Social Research, The University of Michigan, 1969. 


Shaw, M. E., and Wright, J.M. Scales for the measurement of attitudes, New York: 
McGraw-Hill, 1967. 


Simon, A., and Boyer, E. G. Mirrors for behavior Ill: An anthology of observational 
instruments. Wyncote, Pa.: Communications Materials Center, 1974. 


Strauss, M. A., Family measurement techniques. Minneapolis: University of Min- 
nesota Press, 1969. 


Walker, D.K. Socioemotional measures for preschool 


and kindergarten children. san 
Francisco: Jossey-Bass, 1973. 


Webb, E. J., Campbell, D. T., Schwartz, R. D., and Sechrest, L. Unobstrusive me 
ures: Nonreactive research in the social sciences. Chicago: Rand McNally, 1966- 


APPENDIX B 
SEARCH AND 
LOCATER SERVICES 


EDUCATION RESOURCES 
INFORMATION CENTER (ERIC) 


The ERIC network was established by the National Institute of Education (NIE), of the 
U.S. Department of Health, Education, and Welfare. NIE currently supports six- 
teen clearinghouses, each one responsible tor collecting, selecting, abstracting, and 
indexing both published and unpublished materials of theoretical, research, and 
applied interest in its designated content area. In addition to feeding these selected 
Materials into the national ERIC network for dissemination via one of the methods 
listed below, each clearinghouse also provides direct user services, such as newslet- 
ters, magazines, syntheses of the literature on selected topics, and others. Each 
Clearinghouse also will do computerized searches on special topics for users on 
request, 

Each clearinghouse welcomes receipt of two copies of any speeches, papers, or 
other document that might be appropriate for inclusion in the system. For that 
Purpose, or for special requests not covered by the national ERIC publication and 
dissemination system, one should address the specific ERIC clearinghouse. 


ERIC Clearinghouse on Career Education 


The Ohio State University 
Center for Vocational Education, 1960 Kenny Road 


Columbus, Ohio 43210 


ERIC Clearinghouse on Counseling and Personnel Services 
University of Michigan 

School of Education Building, Room 2108 

East University and South University Streets 

Ann Arbor, Michigan 48104 


ERIC C earinghouse on Early Childhood Education 
University of Illinois 
ollege of Education 
w. Pennsylvania Avenue 
Urbana, Illinois 61801 
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ERIC Clearinghouse on Educational Management 
University of Oregon 
Eugene, Oregon 97403 


ERIC Clearinghouse on Handicapped and Gifted Children 
The Council for Exceptional Children 

1920 Association Drive 

Reston, Virginia 22091 


ERIC Clearinghouse on Higher Education 
The George Washington University 

One Dupont Circle, NW, Suite 630 
Washington, D.C. 20036 


ERIC Clearinghouse on Information Resources 
Syracuse University 

School of Education 

Area Instructional Technology 

Syracuse, New York 13210 


ERIC Clearinghouse for Junior Colleges 
University of California 

Powell Library, Room 96 

405 Hilgard Avenue 

Los Angeles, California 90024 


ERIC Clearinghouse on Languages and Linguistics 
Center for Applied Linguistics 

1611 North Kent Street 

Arlington, Virginia 22209 


ERIC Clearinghouse for Reading and Communication Skills 
National Council of Teachers of English 

1111 Kenyon Road 

Urbana, Illinois 61801 


ERIC C earinghouse on Rural Education and Small Schools 
New Mexico State University 
Box 3AP 


Las Cruces, New Mexico 88003 
ERIC C earinghouse on Science, Mathematics, and Environmental Education 
The Ohio State University 


1200 Chambers Road, Third Floor 
Columbus, Ohio 43212 


ERIC Clearinghouse for Social Stud 
Social Science Education Consorti 
855 Broadway 

Boulder, Colorado 80302 


ies/Social Science Education 
um, Inc. 
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ERIC Clearinghouse on Teacher Education 

American Association of Colleges for Teacher Education 
One Dupont Circle, NW, Suite 616 

Washington, D.C. 20036 


ERIC Clearinghouse on Tests, Measurement, and Evaluation 
Educational Testing Service 
Princeton, New Jersey 08540 


ERIC Clearinghouse on Urban Education 
Columbia University 

Teachers College, Box 40 

525 W. 120th Street 

New York, New York 10027 


The ERIC national dissemination system includes the following. Libraries often 
can be of help in locating these materials and services: 


Current Index to Journals in Education, 1969- 

CIJE is a monthly publication that indexes and annotates articles appearing 
in journals in or related to education and all its components. There are also 
semiannual and annual indexes. Available in many libraries or from Macmillan 
Information Division, Order Department, Front and Brown Streets, Riverside, 


N.J. 08075. 
Resources in Education, 1966/67 - . f i 

RIE is a parallel publication that covers all forms of material other than 
journals, including technical and research reports, conference papers, 
speeches, program descriptions, and similar material. Most of these materials 
are unpublished and therefore almost impossible to locate without the 
use of the ERIC system. This too is indexed on a semiannual and annual basis. 
Available in many libraries or from the Government Printing Office, 


Washington, D.C. 20402. 

ERIC Document Collections m ; 
The complete text of all the documents abstracte in Resources in 

Education and not restricted by copyright is available on microfiche or hard 

Copy reproductions from the ERIC Document Reproduction Service, Post Office 

Box 190, Arlington, Va. 22210. Many libraries throughout the country maintain 

a complete and continuing collection of the Document Collection on microfiche. 


PSYCHOLOGICAL ABSTRACTS INFORMATION SERVICE 


This js 1 PsycINFO, the American Psychological 


a group of services available fron l ; 
“S0Ciation 1200 Seventeenth Street NW, Washington, D.C. 20036. The base is the 


S¥chological Abstracts, a monthly journal published by APA and containing 
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nonevaluative summaries of the psychological literature as found in journals and 
books from all parts of the world. There also are semiannual and three-year cumula- 
tive indexes. j 

In addition to the Psychological Abstracts and its indexes, which are available 
in many libraries, APA offers the following locater services: 


Psychological Abstracts Direct Access Terminal (PADAT) . ; > 
An organization leases a computer terminal that then provides direct a 
cess to the data base from the organization's own facilities. 


Psychological Abstracts Tape Edition Lease or License (PATELL) ’ a 
The user obtains the magnetic tapes of PsycINFO records on either a 
annual lease or license basis. This is intended for information analysts an 


dissemination centers that intend to serve either their own members (lease) © 
others (license). 


Psychological Abstracts Search and Retrieval (PASAR) 

This is the service most likely to be used by individuals. The user fills out à 
form that specifies the topic to be searched and mails it to APA. A printout © 
relevant abstracts from the Psychological Abstracts is mailed to the user at a cost 
based on the amount of computer time required to perform the search. 


COMMERCIAL ON-LINE RETRIEVAL SYSTEMS 


Lockheed’s DIALOG and System Development Corporation’s ORBIT offer service? 
similar to those provided by PASAR, but for many data bases combined. At the end ° 
1976, DIALOG was providing access to 45, ORBIT to 20 data bases, DIALOG, fOT 
example, may search, in response to a single query, ERIC, Psychological Abstracts 
Sociological Abstracts, NTIS (National Technical Information Service reports Cover” 
ing a wide range of disciplines from over 240 U.S. government agencies—more® rhan 
500,000 citations), and Dissertation Abstracts (again more than 500,000 reference 


to doctoral dissertations since 1861). Search results are in the form of a bibliographY” 
often with accompanying abstracts, 


Search costs are based 
references located; $35 to 
available at hundre 
the United Kingdo 


: s are 
) $50 might be considered average charges. Searches 2” 
ds of sites throughout the U.S and Canada, in Sweden, Mexico. 

A Au s growing rapidly. : in- 
s are subsidized, often through affiliation with an 


NATIONAL REFERRAL CE 
TECHNOLOGY NTER FOR SCIENCE AND 


This is a service arm of the Library of Congress (address its Science and Technolo | 
DINiBIOR, 10 First Street SE, Washington, D.C. 20540). It provides a free refert 
service by mail or phone in the physical, biological social z engineering scien® - 
The center directs inquiries not to literature but to live sources come and addres 
ses of organizations or individuals that are known to provide Tekna of information 
one is seeking. The Center also publishes selections from their data base of name 
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and addresses; a 700-page compilation on the Social Sciences was published in 
1973 (GPO Catalog no. LC 1.31: D62/2-973) and is available at a price of $6.90 
trom the Government Printing Office, Washington, D.C. 20402 


SMITHSONIAN SCIENCE INFORMATION EXCHANGE 


SSIE provides several specialized services, including both custom searches and pub- 
lication of noncustom research information packages on topics of high current 
interest (examples of the latter drawn from the Therapy, Rehabilitation and Counsel- 
Ing area within the Behavioral Science division are “Vocational Counseling” and 
“Rehabilitation of adult and juvenile offenders”). The data bank consists of brief 
lescriptions of research projects as received from over 1300 funding agencies at the 
time of funding. For custom searches the user may specify the subject, names of 
Investigators, funding organizations, or geographic areas to be sought in the compu- 
ter search. Because of the nature of this program, it is especially useful for informa- 
tion about research in progress, and for information about which funding organiza- 
tions are supporting research in designated areas. 


INFORMATION RESOURCE CENTERS 


Exemplified by RISE in Pennsylvania and SMERC in California but located through- 
Out the country, these are nonprofit, usually government sponsored organizations 
that, among many other services to educators, prepare full information packages 
Containing actual full text copies of documents and journal articles found through 
Computer searching, a bibliography, a list of resource persons, and so on. Costs vary. 
An original RISE search in 1976 was $300, a package duplicating a search already on 
ile was $25, and a bibliography alone was $2.50. — — ; 

“Information Brokers,” for profit organizations offering similar services are also 
available and are the latest development in this fast growing area. 


INDEXES AND ABSTRACTS 


In addition to the computerized and other special locater services listed above, there 
are of course the published indexes and abstracts such as the Education Index, 
Psychological Abstracts, College Student Personnel Abstracts, and Sociological 
Abstracts, A university librarian specializing in reference service is usually the best 
Source of help in locating and using these sources. 
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counseling interventions, 269 
counselor competencies needed, 276-284 
counselor role, 268 
counselor training, 268 
ecosystems, 271-282 
setting goals, 274-276 
student characteristics, 269-270 
students as colleagues, 281-282 
topics for study, 284-287 
trends, 270-271 


College Student Personnel Abstracts, 421 
Commission on Community Interrelations, 80 
Community counseling research, 343-356 
dissemination, 354-355 
examples, 350-352, 352-353, 355 
goals, 349-354 
implementation, 349-354 
planning stage, 347-349 
Confidentiality, 376, 378 
Consent, informed, 366-367, 372-374, 378, 
380, 393-395 
Construct, 37-38 
Construct validity, 40 
Consultation, research on, 285-286, 
345-346, 347 
Consumer acceptance of research, 107-110 
Contributions of research, 29-36 
Control or comparison group, 43-44, 55-57, 
85, 119, 325 
Conventions and research, 102, 411 
Correlational studies, 14, 49, 52-53, 
118-119, 324, 325 
Correlation coefficient, of reliability, 40 
of validity, 41, 52-53, 324, 325 
Cost-benefit analysis, 353 
Counselor, effectiveness, 285 
and law, 365 
responsibility in research, 35-36 
role in research diffusion, 102 
Counselor Education and Supervision, 58 
Criterion, 50-54 
client satisfaction, 220-221 
immediate versus long-range, 218-219 
in longitudinal studies, 211-221 
objective, 220 


in vocational and employment counseling, 
331-333 
Critical incident technique, 298 
Current Index to Journals in Education, 105, 
419 


Data banks, 376, 378 
Data collection, biographical information, 
327 
in college research, 280-281 
effect of ethical practices, 387-390 
from files, 224, 327-328 
incidental, 224 
interviews, 18-20, 156-157, 167-168, 
328-329 
inventories, 330-331 
in longitudinal research, 214-215, 
225-226 
questionnaires, 329-330 
in rehabilitation, 311-312, 327-331 
scales, 329-330, 415-416 
shadowing, 254-255 
sources, 225-226 
subjective, 225 
tests, 330-331 
Deception experiments, 326, 373-374, 
386-387 
Deductive reasoning, 37 
Delphi technique, 183, 189 
Depression Adjective Check List, 131-132 
Descriptive research, 48-55, 121, 
323-325 
Design of research, 42-47, 130-142, 
323-331 
textbooks on, 42 
DHEW regulations, 379-383 
Diagnostic action research, 81-83, 88-90, 
95 
DIALOG, 420 
Dictionary of Occupational Titles, 34 
Differential Aptitude Tests, 103 
Diffusion of research finding, see 
Dissemination 
Disability, research on, 295-297 
Dissemination, 101-111, 413-414 
in college, 284 
in community, 354-355 
factors in, 105-111 


models, 102-105 
problem-solver, 103-104 
research and development, 103 
social interaction, 104 

in rehabilitation, 301-304 

Dissertation Abstracts, 420 
Duke Power Case, 330 


Ecological approach, 271-282 
Ecosystems, 271-282 
Educational Resources Information Center, 
see ERIC 
Education Extension Agent program, 104-105 
Education Index, 421 
sensta versus Baird, 369-370, 399 
lementary School Guidance and 
$i Counseling, 58 
ementary school research exa mple, 
Epit nlite 256-258 
lan action research, 84-85, 91-93, 95 
yment counseling research, see 
Vocational and employment 
ENT research 
ment, study of, 252-260, 269-281 
ERIC or versus Arkansas, 368, 399 
Chea 98, 103, 105, 191, 417-419 
aringhouses, 417-419 
i P ota Collections, 419 
a! aspects of research, see Legal aspects 
Balas en 
alfa 35-36, 80, 177-197 
An education, 194-195 
au Dei activities, 308-311 
eee Sial materials, 286 
Se ee 191-193, 285 
Som, unseling, 276, 282-283 
fine nity counseling, 343-356 
dene 178-181 
fe OPmental programs, 286-287 
Program, 90-91, 195-196 
tom m counseling, 325 
egal es, 327-328 
with 1 Pects, 392-393 
mod Ongitudinal data, 213-223 
el, 181-196 
a 186 
es of criteria, 187-188 
+ 182-184 
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discrepancy evaluation, 185 
eclectic, 189-196 
economic, 185 
formative/summative, 186-187 
medical, 184 
research design, 182 
transactional, 187 
occupational information, 325-326 
of paraprofessionals, 285 
through participant observation, 170-171 
of published research, 58-68 
of referral resources, 307-308 
stages, 189-196 
Example of good research report, 61-68 
Expectancy table, 52-53, 324 
Experimental action research, 85-86, 93-94, 
95-96 
Experimental group, 43-44, 55-57, 119,325 
Experimental research, 55-57, 119, 325-327 


Factorial design, 46 

Failures of research, 7-10, 177 

Field studies, 12, 48—49, 343-356 
Files, data from, 224, 327-328 
Financial resources for research, 110 
Fisher's exact probability test, 146 


Follow-up, 223 


Gault, In re, 371, 399 
General Aptitude Test Battery, 324, 330, 331, 
333 
General Educational Development tes 
Ginsburg versus New York, 371, 399 
Goals, in college counseling, 274-276 
in community research, 348, 349-354 
of counseling, 219-221 
distal, 349 
institutional, 206, 219-221, 223-224 
proximal, 349 
of research, 6 
in school settings, 240-245 
search, 379-383 
nnecticut, 369-370, 


t, 324 


Government and re 

Griswold versus Co! 
399 

Group comparison, 54-55 

Group data, 228-229 

Groups of subjects, 43-44 
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Handicapped worker, 293-313, 334 

High school equivalency test, 324 

High school research example, 254-255, 
259-260 

Historical context, 222-223 

Historical research, 57-58 

textbooks on, 58 

Human Resource Development model, 
93-94 

Human services personnel, 343-344 

Hypotheses, 37, 41-42, 59, 85 


Ideographic method, 118 
Implementing research findings, 20-22, 
101-111 
in college, 284 
factors in, 105-111 
manner and extent, 110 
Independent observer, 163-166 
Individual, differences in, 333-335 
emphasis in research, 13-15 
study of, 117-147, 228-229 
qualitatively, 120-121 
quantitatively, 121-147 
total, as research focus, 15-16 
Inductive reasoning, 37 
Information Resource Centers, 421 
Innovation, adoption process, 104 
factors in acceptance, 105-111 
Institutional review boards, 379-380 
Intensive experimental designs, 121-147 
annotated time series, 131-134 
combination designs, 142 
interrupted or AB, 134-1 37 
multiple baseline, 137-141 
multiple time series, 137 
split-middle method, 142-146 
Interest inventory, 330-33] 
Interview as research method, 18-20, 
156-157, 167-168, 328-329 
Introspection in data collection, 156 


Job satisfaction, 336 
Joint Liaison Committee, 302 
Journals, changes needed, 411 
how to read, 58-68 
for research publication, 58 


Journal of Counseling Psychology. 57, 58, 
103 

Journal of Educational Research, 58 

Journal of Employment Counseling, 58 

Journal of Rehabilitation, 303 

Journal of Vocational Behavior, 58 

Jury “bugging” studies, 373 


Kaimowitz versus Department of Mental 
Health, 381, 399 
Knowledgeable other, 162-166 


Laboratory studies, 8, 48-49, 345 
Leadership and organizational change, 
107-108 
Legal aspects of research, 363-397 
competence of counselor, 378 
confidentiality, 376, 378 
disclosure, 388 
government role, 379-383 
informed consent, 366-367, 372-374, 
378, 380, 393-395 
judiciary role, 368-369 
Privacy, 363, 369-371, 
393-395 
privileged communication, 396 
protection of subjects, 378, 379-383, 
392-393 
in public institutions, 367-368 
right to know, 383-390 
societal versus individual rights, 
383-390 
Supreme Court, 369-371 
U. S. Constitution, 369, 375-377 
Library of Congress, 420 
Linking agent, 21-22 
Literature search, 32-33, 98 
Longitudinal research, 203-230 
criteria in, 211-221 
developmental models, 207-210 
documenting activities, 211 
goals of institution, 206, 219-221, 
223-224 
objectives, assessment of, 206 
planning counseling activities, 2 
in rehabilitation counseling, 327 
revising activities, 226-227 


10-211 


Malpractice, 372 
Measurement, 38, 39-41, 99-100, 
415-416 
textbooks on, 39 
unobtrusive, 354 
see also Assessment: Tests 
Measurement and Evaluation in Guidance, 58 
Mental retardation, research on, 296, 
311-312 
Merriken versus Cressman, 364, 365-368, 
374-379, 384, 393, 399 
Microcounseling, 87-97 
Minnesota Importance Questionnaire, 62 
Minnesota Vocational Interest Inventory, 331 
MMPI, 103, 124 
Multiple baseline design, 137-141 
Multiple regression, 52 
Multiple time series design, 137 


Natanson versus Kline, 372, 399 
National Association of Student Personnel 
Administrators, 102 
National Center for Educational Statistics, 98 
National Commission for the Protection of 
Human Subjects, 380-383 
National Referral Center for Science and 
Technology, 420-421 
National Research Act, 380-383 
National Training Laboratories, 80 
Naturalistic research, see Field studies 
Needs assessment, in community settings, 
347-349 
legal aspects, 393 
in schools, 245-250 
see also Assessment 
Neuroticism Scale Questionnaire, 330 
Note taking, 161-171 


Obedience, study of 373-374 
Objectives, see Goals 
Observation, 129-131, 155-172 
Covert, 386 
Occupational Outlook Handbook, 323-324 
Occupational Values Inventory, 327 
Occupations Finder, 34 
Olmstead versus United States, 363, 369, 
399 


SUBJECT INDEX 437 


Operational definitions, 37-39, 59, 124, 128, 
350-351 
ORBIT, 420 


PADAT, 420 
Paraprofessional counselors, 285 
Parents, consent, 371 
contacts, 215-218 
Parody of research report, 61-68 
Participant action research, 83-84, 90-91, 95 
Participant observation research, 155-172 
for counselors, 166-171 
in evaluating change, 167-169 
recording methods, 161-162 
in studying social systems, 168-169 
in understanding group dynamics, 
167-169 
in understanding other care-givers, 
169-171 
Participant observer, complete, 156 
entry into setting, 157-159 
involvement with people and setting, 
159-161 
participant as observer, 156 
roles, 156 
PASAR, 98, 103, 420 
PATELL, 420 
Personal Data Sheet, 38 
Person-environment fit, 279-281 
Personnel and Guidance Journal, 4 
PERT, 183 
Planned Parenthood of Central Missouri 
versus Danforth, 371, 399 
Pratt versus Davis, 372, 399 
Predictor, 52-54 
Prisoners, legal rights as subjects, 381-383 
Privacy and research, 363, 369-371, 
393-395 
Professional practice and research, 30-32, 
33-35 
Program development, 284 
Projective tests, legal aspects, 393 
Protection of human subjects, 378, 379-383 
Psychological Abstracts, 421 
Information Service, 419-420 
PADAT, 420 
PASAR, 420 
PATELL, 420 
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Qualitative emphasis in research, 18 
Qualitative methods, of studying 
individuals, 120-121 
Quantitative methods, of studying 
individuals, 121-147 
QUESTA, 259-260 
Questionnaire, in longitudinal research, 
212-213 
in rehabilitation research, 298-299 
as research method, 19-20, 366 
in vocational research, 329-330 


Race differences, 334 
Random assignment of subjects, 44, 55-56 
Ratings, 125-126, 332 
Readiness for Counseling Scale, 32 
Reading research reports, 58-68 
background needed, 36-47 
benefits for research, 32-33 
Recording data, 161-162, 211, 225-226 
Regional Rehabilitation Research Institutes, 
302 
Rehabilitation counseling, defined, 
292-295 
work of counselors, 293-295 
Rehabilitation Counseling Bulletin, 58, 305 
Rehabilitation counseling research, 293-313 
acceptance of disability, 300-301 
constructs, research on, 299-301 
disability, 295-297 
evaluation of, 304-305 
local studies, 305-312 
service delivery, 297-299 
surveys of counselors, 298-299 
utilization of, 301-304 
Reliability, 39-40, 56, 59, 99-100 
of behavioral measures, 129-130 
legal aspects, 393 
Remediation, identification through research, 
250-252 
Repeated assessments, 226 
Reporting research, 20-22 
Research, definitions, 179-181 
Research awards, 411-412 
Research and Guidance Laboratory, 214 
Research specialist, 412-413 
Research and Training Centers, 302 
Research Utilization Laboratories, 302 


$ 


Research Utilization Specialist Programs, 
303-304 

Resources in Education, 419 

Response percentage, 227-228 

Retrieval systems, 417—421 

RISE, 421 

Roe versus Wade, 371, 399 


Sampling, 42-43, 54, 59, 97-98, 100, 
227-228 
Satisfaction of client as criterion, 220-221 
Scales in data collection, 329-330, 415-416 
School, research in, 237-262 
changing student populations, 238-239 
environment, 252-260 
School counselor, 237-262 
accountability, 244, 260-261 
aversion to research, 240 
as generalist, 240 
origins and status, 237-238 
research role, 240-245 
Scientist-practitioner model, 409 
Self-concept, 125-128 
Semi-log chart, 141 
Sex differences, 333-334 
Shadowing as source of data, 254-255 
Significance, statistical, 47, 119 
Single subject research, 117-147 
SMERC, 421 
Smithsonian Science Information Exchan8& 
421 
Social class differences, 334 
Sociological Abstracts, 420, 421 
Solomon’s design, 44-45 
Split-middle method, 142-146 
Stability of measures, 39-40 
Stages of research study, 97-101, 311 
323-331, 346-356 
Statistics, 46-47, 59, 119, 100-101, 312, 
textbooks, 46 
Strong-Campbell Interest Inventory, 103 
Subject, 42-43 
children, 382-383 
collaborator, 16-17, 281-282 
informed, 387-390 
protection of, 378, 379-383 
rapport with, 160 
Subjective data, 225 


312, 


322 


Subjective emphasis in research, 18 
Supervision of research, 164 
Survey, method, 324 

of rehabilitation counselors, 298-299 


Tennessee Self-Concept Scale, 325 
Tests, in data collection, 330-331 
legal aspects, 378-379 
limitations, 124 
see also Assessment: Measurement 
Textbooks on research methods, 39, 42, 46, 
47,58 
Theory, and research, 30-32, 33-35 
Theory building, 36-39 
Time-lagged design, 137 
Timelines of study, 221-223 
Time series, 45, 123 
annotated, 131-134 
combination, 142 
interrupted or AB, 131-137 
multiple, 137 
multiple baseline, 137-141 
split-middle method, 142-146 
Timing of measures, 44, 54 
Tinker versus Des Moines School District, 
371, 399 
Training counselors in research, 22, 410-411 
Training effectiveness, 285-286 
reatment groups, 55-57 
t-test, 325 


a 
YPes of research, 47-58, 323-327 


Uni sos 
"on Pacific Railroad Company versus 
Botsford, 369, 399 


ver 
Nited States versus Doe, 396, 400 


V; ray 
city, 56, 59, 99-100 
ehavioral measures, 129 
“Bal aspects, 393 
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Variable, criterion, 50-54 
dependent, 45-46, 56, 345 
independent, 45—46, 56, 345, 387 
inferred, 45 
predictor, 52-54 
status, 45 

Victim-Witness Advocacy Program, 

350-352 
Videotaping, 87-97 
Vocational development, stages, 
208-209 
Vocational and employment counseling 
research, 321-338 
criteria, 331-333 
data collection, 327-331 
descriptive, 323-325 
experimental, 325-327 
individual differences, 323-335 
topics, 335-337 

Vocational Guidance Quarterly, 58 

Vocational identity, 336 

Vocational maturity, 325, 336-337 

Vocational Maturity Inventory, 325 

Vocational Preference Inventory, 34 

Vocational Rehabilitation Administration, 

301 


Washer-nut-bolt task, 307 
Wilkinson versus Vesey, 372, 400 
Wonderlic Personnel Test, 324 
Woods County Project, 297 

Wood versus Strickland, 369, 400 
Work Adjustment Rating Form, 332 


Work behavior, 333-335 

Work evaluation studies, 306-307 
Work expectations, 336 
Workshops on research, 411 
Work values, 335 


Yoked and unyoked measures, 94, 95 
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